Sep 28 15:56:22 devstack cinder-volume[75976]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 15:56:22 devstack cinder-volume[75976]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 15:56:22 devstack cinder-volume[75976]: we strongly recommend against using it for new projects. Sep 28 15:56:22 devstack cinder-volume[75976]: If you are already using Eventlet, we recommend migrating to a different Sep 28 15:56:22 devstack cinder-volume[75976]: framework. For more detail see Sep 28 15:56:22 devstack cinder-volume[75976]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 15:56:22 devstack cinder-volume[75976]: import eventlet # noqa Sep 28 15:56:24 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 15:56:24 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 15:56:24 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 15:56:25 devstack cinder-volume[75976]: INFO dbcounter [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Registered counter for database cinder Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG oslo_db.sqlalchemy.engines [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writer thread running {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:56:26 devstack cinder-volume[75976]: INFO cinder.rpc [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 15:56:26 devstack cinder-volume[75976]: INFO cinder.rpc [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG oslo_db.sqlalchemy.engines [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:56:26 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Determined volume DB was empty at startup. Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG cinder.volume.manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75976) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 15:56:26 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 15:56:26 devstack cinder-volume[75976]: WARNING stevedore.named [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:56:26 devstack cinder-volume[75976]: WARNING castellan.key_manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:56:26 devstack cinder-volume[75976]: WARNING cinder.keymgr.conf_key_mgr [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG cinder.volume.drivers.lvm [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75976) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 28 15:56:26 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75976) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_concurrency.processutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.452s {{(pid=75976) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_db.sqlalchemy.engines [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:56:27 devstack cinder-volume[75976]: INFO cinder.rpc [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 28 15:56:27 devstack cinder-volume[75976]: INFO cinder.rpc [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 28 15:56:27 devstack cinder-volume[75976]: WARNING stevedore.named [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 15:56:27 devstack cinder-volume[75976]: WARNING castellan.key_manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 15:56:27 devstack cinder-volume[75976]: INFO cinder.volume.manager [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_db.sqlalchemy.engines [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75976) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:56:27 devstack cinder-volume[75976]: INFO oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Starting 1 workers Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Started child 76133 {{(pid=75976) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Full set of CONF: {{(pid=75976) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] ******************************************************************************** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Configuration options gathered from: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] ================================================================================ {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] allow_availability_zone_fallback = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] allow_compression_on_image_upload = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] allowed_direct_url_schemes = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] api_rate_limit = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] auth_strategy = keystone {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] az_cache_duration = 3600 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_availability_zone = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_host = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_stats_polling_interval = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backup_api_class = cinder.backup.api.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backup_name_template = backup-%s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backup_use_same_host = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backup_use_temp_snapshot = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] chap_password = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] chap_username = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_internal_tenant_project_id = 148bcae3894e4b7fb40c29716f06c59a {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_internal_tenant_user_id = 2e3fd9bbcf8c4b4d84e3616a8898cabd {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cloned_volume_same_az = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cluster = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] compression_format = gzip {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] compute_api_class = cinder.compute.nova.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] config_dir = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] config_source = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] control_exchange = openstack {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] debug = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] default_availability_zone = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] default_group_type = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] default_volume_type = lvmdriver-1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] disk_geometry = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_client_cert = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_client_cert_key = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[76133]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_data_namespace = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_ssl_cert_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_ssl_cert_verify = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] driver_use_ssl = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] enable_force_upload = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] enable_new_services = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] enable_unsupported_driver = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] enforce_multipath_for_image_xfer = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] filter_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_api_insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_api_servers = ['http://192.168.122.162/image'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_api_ssl_compression = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_ca_certificates_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_catalog_info = image:glance:publicURL {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_num_retries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance_request_timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] goodness_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] graceful_shutdown_timeout = 5 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] group_api_class = cinder.group.api.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] host = devstack {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_compress_on_upload = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_conversion_address_space_limit = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_conversion_cpu_limit = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_conversion_disable = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_introspection_address_space_limit = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_introspection_cpu_limit = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_upload_use_cinder_backend = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_upload_use_internal_tenant = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_volume_cache_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_volume_cache_max_count = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] image_volume_cache_max_size_gb = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] init_host_max_objects_retrieval = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] instance_format = [instance: %(uuid)s] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iscsi_target_flags = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iscsi_write_cache = on {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iser_helper = tgtadm {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iser_ip_address = 192.168.122.162 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iser_port = 3260 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_color = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_config_append = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_dir = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_options = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_rotate_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_rotate_interval_type = days {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] log_rotation_type = none {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] max_age = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] max_logfile_count = 30 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] max_logfile_size_mb = 200 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] max_over_subscription_ratio = 20.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] message_reap_interval = 86400 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] message_ttl = 2592000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] migration_create_volume_timeout_secs = 300 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] monkey_patch = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] monkey_patch_modules = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] my_ip = 192.168.122.162 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] no_snapshot_gb_quota = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] num_iser_scan_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] num_shell_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] num_volume_device_scan_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] nvmeof_conn_info_version = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] nvmet_ns_id = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] nvmet_port_id = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_max_limit = 1000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_ext_list = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_listen_port = 8776 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_use_ssl = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] osapi_volume_workers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] per_volume_size_limit = -1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] periodic_fuzzy_delay = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] periodic_interval = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] public_endpoint = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] publish_errors = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_backup_gigabytes = 1000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_backups = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_gigabytes = 1000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_groups = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_snapshots = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] quota_volumes = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] rate_limit_burst = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] rate_limit_except_level = CRITICAL {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] rate_limit_interval = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] reinit_driver_count = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] replication_device = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] report_discard_supported = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] report_interval = 120 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] reservation_clean_interval = 86400 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] reservation_expire = 86400 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] reserved_image_namespaces = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] reserved_percentage = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] rpc_response_timeout = 120 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] run_external_periodic_tasks = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] scst_target_driver = iscsi {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] scst_target_iqn_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_down_time = 720 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] shell_completion = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] snapshot_name_template = snapshot-%s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] snapshot_same_host = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] split_loggers = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] state_path = /opt/stack/data/cinder {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] storage_availability_zone = nova {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] storage_protocol = iSCSI {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] syslog_log_facility = LOG_USER {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_helper = lioadm {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_ip_address = 192.168.122.162 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_port = 3260 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_protocol = iscsi {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] target_secondary_ip_addresses = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] trace_flags = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] transport_url = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] until_refresh = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_chap_auth = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_default_quota_class = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_journal = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_json = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_multipath_for_image_xfer = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_stderr = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] use_syslog = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] verify_glance_signatures = enabled {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_api_class = cinder.volume.api.API {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_backend_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_clear = zero {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_clear_ionice = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_clear_size = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_copy_bps_limit = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_dd_blocksize = 1M {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_name_template = volume-%s {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_service_inithost_offload = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volume_usage_audit_period = month {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] zoning_mode = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_concurrency.disable_process_locking = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.auth_section = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.auth_type = password {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.auth_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.cache = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.include_service_catalog = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.interface = public {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_password = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcache_username = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.region_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.service_type = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.backend = dogpile.cache.null {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.backend_argument = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.backend_expiration_time = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.config_prefix = cache.oslo {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.debug_cache_backend = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.enable_retry_client = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.enable_socket_keepalive = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.expiration_time = 600 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.hashclient_retry_attempts = 2 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_dead_retry = 300 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_pool_maxsize = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_sasl_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.password = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.proxies = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.redis_db = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.redis_server = localhost:6379 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.retry_attempts = 2 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.retry_delay = 0.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.socket_keepalive_count = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.socket_keepalive_idle = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.socket_keepalive_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.socket_timeout = 1.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.tls_allowed_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.tls_cafile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.tls_certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.tls_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.tls_keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cache.username = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] coordination.backend_url = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.asyncio_connection = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.asyncio_slave_connection = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.backend = sqlalchemy {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.connection = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.connection_debug = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.connection_parameters = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.connection_recycle_time = 3600 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.connection_trace = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.db_inc_retry_interval = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.db_max_retries = 20 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.db_max_retry_interval = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.db_retry_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.max_overflow = 50 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.max_pool_size = 5 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.max_retries = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.mysql_wsrep_sync_wait = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.pool_timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.retry_interval = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.slave_connection = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.sqlite_synchronous = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.synchronous_reader = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] database.use_db_reconnect = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_tracing.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.connection_string = messaging:// {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.es_doc_type = notification {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.es_scroll_size = 10000 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.es_scroll_time = 2m {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.filter_error_trace = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.hmac_keys = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.sentinel_service_name = mymaster {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.socket_timeout = 0.1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.trace_requests = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler.trace_sqlalchemy = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler_jaeger.process_tags = {} {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler_jaeger.service_name_prefix = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] profiler_otlp.service_name_prefix = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.enforce_new_defaults = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.policy_default_rule = default {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.policy_file = policy.yaml {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.group = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.helper_command = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] privsep_osbrick.user = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.group = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.helper_command = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] cinder_sys_admin.user = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.auth_section = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.auth_type = password {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.cafile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.collect_timing = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.send_service_user_token = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.split_loggers = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.tls_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] service_user.tls_min_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.auth_section = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.auth_type = password {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.collect_timing = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.region_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.split_loggers = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.tls_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] glance.tls_min_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.backend_availability_zone = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.chap_password = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.chap_username = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.disk_geometry = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_client_cert = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_client_cert_key = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_data_namespace = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.driver_use_ssl = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.extra_capabilities = {} {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.filter_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.goodness_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iscsi_target_flags = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iscsi_write_cache = on {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iser_helper = tgtadm {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iser_port = 3260 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.lvm_share_target = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.lvm_type = auto {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.num_shell_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.051s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.replication_device = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.report_discard_supported = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.reserved_percentage = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_helper = tgtadm {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_port = 3260 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_protocol = iscsi {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.trace_flags = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.unique_fqdn_network = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.use_chap_auth = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_backend_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_clear = zero {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_clear_ionice = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_clear_size = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_reports.file_event_handler = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_reports.log_dir = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.backend_host = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.chap_password = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.chap_username = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.disk_geometry = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_client_cert = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.extra_capabilities = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.filter_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.goodness_function = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack sudo[76138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iser_helper = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iser_ip_address = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iser_port = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.lvm_share_target = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.lvm_type = auto {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.num_shell_tries = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.replication_device = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.report_discard_supported = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.reserved_percentage = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.scst_target_driver = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.storage_protocol = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_helper = lioadm {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_ip_address = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_port = 3260 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.trace_flags = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.use_chap_auth = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_clear = zero {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_clear_size = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] lvmdriver-1.volumes_dir = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_notifications.driver = [] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_notifications.retry = -1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] key_manager.fixed_key = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.barbican_api_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.barbican_endpoint = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.barbican_endpoint_type = public {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.barbican_region_name = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.cafile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.collect_timing = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.number_of_retries = 60 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.retry_delay = 1 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.send_service_user_token = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.split_loggers = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.tls_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.tls_min_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.verify_ssl = True {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican.verify_ssl_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.auth_section = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.auth_type = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.cafile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.certfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.collect_timing = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.insecure = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.keyfile = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.split_loggers = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.timeout = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.tls_ciphers = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] barbican_service_user.tls_min_version = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.approle_role_id = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.approle_secret_id = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.auth_method = approle {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.auth_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.kv_mountpoint = secret {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.kv_path = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.kv_version = 2 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.namespace = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.root_token_id = **** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.ssl_ca_crt_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.timeout = 60.0 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.token_file = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.token_role = None {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.use_ssl = False {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 15:56:27 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] ******************************************************************************** {{(pid=75976) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.407s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:27 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:27 devstack sudo[76261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:27 devstack sudo[76261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:28 devstack sudo[76261]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.344s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 15:56:28 devstack cinder-volume[76133]: INFO cinder.brick.local_dev.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:28 devstack sudo[76371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:28 devstack sudo[76371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:28 devstack sudo[76371]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG cinder.brick.local_dev.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76133) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 28 15:56:28 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:28 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:28 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:29 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.543s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:29 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:29 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:29 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.319s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:29 devstack sudo[76748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 28 15:56:29 devstack sudo[76748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:29 devstack sudo[76748]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.323s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:29 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:29 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:29 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:30 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.319s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:30 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:30 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:30 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:30 devstack sudo[76844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:30 devstack sudo[76844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:30 devstack sudo[76844]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.317s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:30 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:30 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:30 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:30 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:30 devstack sudo[76931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:30 devstack sudo[76931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:31 devstack sudo[76931]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.286s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:31 devstack cinder-volume[76133]: INFO cinder.volume.drivers.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:31 devstack sudo[76941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:31 devstack sudo[76941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:31 devstack sudo[76941]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:31 devstack sudo[76944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:31 devstack sudo[76944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:31 devstack sudo[76944]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:31 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:31 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:31 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:32 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:32 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:32 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:32 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:32 devstack sudo[76953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:32 devstack sudo[76953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:32 devstack sudo[76953]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:32 devstack cinder-volume[76133]: INFO cinder.volume.driver [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG cinder.volume.driver [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76133) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_db.sqlalchemy.engines [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76133) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writer thread running {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG cinder.db.api [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Building query based on filter {{(pid=76133) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG cinder.image.image_utils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76133) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 15:56:32 devstack cinder-volume[76133]: INFO cinder.keymgr.migration [None req-5ad499a9-5d36-4dc1-8981-95c0d66b9cc9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:56:32 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:32 devstack sudo[76958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:32 devstack sudo[76958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:33 devstack sudo[76958]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:33 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:33 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:33 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:33 devstack sudo[76965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:33 devstack sudo[76965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:33 devstack sudo[76965]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:33 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:33 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:33 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:34 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:56:34 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Driver initialization completed successfully. Sep 28 15:56:34 devstack cinder-volume[76133]: INFO cinder.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Initiating service 2 cleanup Sep 28 15:56:34 devstack cinder-volume[76133]: INFO cinder.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Service 2 cleanup completed. Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG cinder.service [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Creating RPC server for service cinder-volume {{(pid=76133) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG cinder.service [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76133) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 15:56:34 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:34 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:56:34 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:34 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:34 devstack sudo[76976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:34 devstack sudo[76976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:34 devstack sudo[76976]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:34 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:34 devstack sudo[76982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:56:34 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:35 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:35 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:35 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:56:35 devstack sudo[76986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:56:35 devstack sudo[76986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:56:35 devstack sudo[76986]: pam_unix(sudo:session): session closed for user root Sep 28 15:56:35 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:56:35 devstack cinder-volume[76133]: INFO cinder.volume.manager [None req-6ea8d1d8-5388-4d7d-a38c-da02bf73d6f0 None None] Driver post RPC initialization completed successfully. Sep 28 15:56:37 devstack cinder-volume[75976]: DEBUG dbcounter [-] [75976] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75976) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:44 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:56:45 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:57:06 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:57:06 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:57:06 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread info: [<_MainThread(MainThread, started 125377740021888)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:58:06 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:58:06 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:58:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:06 devstack sudo[80926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:58:06 devstack sudo[80926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:06 devstack sudo[80926]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:06 devstack sudo[81051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:58:06 devstack sudo[81051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:07 devstack sudo[81051]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:07 devstack sudo[81213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:58:07 devstack sudo[81213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:07 devstack sudo[81213]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:58:07 devstack sudo[81358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:58:07 devstack sudo[81358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:58:07 devstack sudo[81358]: pam_unix(sudo:session): session closed for user root Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 15:58:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread info: [<_MainThread(MainThread, started 125377740021888)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 15:58:45 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:58:45 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:06 devstack sudo[83281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 15:59:06 devstack sudo[83281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:06 devstack sudo[83281]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:06 devstack sudo[83284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:59:06 devstack sudo[83284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:06 devstack sudo[83284]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:06 devstack sudo[83287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 15:59:06 devstack sudo[83287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:07 devstack sudo[83287]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 15:59:07 devstack sudo[83290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 15:59:07 devstack sudo[83290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 15:59:07 devstack sudo[83290]: pam_unix(sudo:session): session closed for user root Sep 28 15:59:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 15:59:07 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:06 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:00:06 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:00:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:06 devstack sudo[84770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:00:06 devstack sudo[84770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:06 devstack sudo[84770]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:06 devstack sudo[84776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:00:06 devstack sudo[84776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:07 devstack sudo[84776]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:07 devstack sudo[84779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:00:07 devstack sudo[84779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:07 devstack sudo[84779]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:00:07 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:00:07 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:00:07 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.328s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:00:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread info: [<_MainThread(MainThread, started 125377740021888)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:00:45 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:SELECT=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:00:45 devstack cinder-volume[76133]: DEBUG dbcounter [-] [76133] Writing DB stats cinder:UPDATE=1 {{(pid=76133) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:06 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:06 devstack cinder-volume[76133]: DEBUG cinder.volume.drivers.lvm [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Updating volume stats {{(pid=76133) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 28 16:01:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:06 devstack sudo[85732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 28 16:01:06 devstack sudo[85732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:06 devstack sudo[85732]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:06 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:06 devstack sudo[85736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:01:06 devstack sudo[85736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:07 devstack sudo[85736]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:07 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 28 16:01:07 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:07 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:07 devstack sudo[85753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 28 16:01:07 devstack sudo[85753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:07 devstack sudo[85753]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_concurrency.processutils [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76133) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG cinder.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Notifying Schedulers of capabilities ... {{(pid=76133) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG oslo_service.periodic_task [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] Running periodic task VolumeManager._thread_info {{(pid=76133) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread count: 6 {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:01:07 devstack cinder-volume[76133]: DEBUG cinder.volume.manager [None req-33f4365c-c99e-4f16-ab3c-d43c8bcefb79 None None] thread info: [<_MainThread(MainThread, started 125377740021888)>, , , , , ] {{(pid=76133) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:01:19 devstack cinder-volume[75976]: INFO oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Caught SIGTERM, stopping children Sep 28 16:01:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Acquiring lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Acquired lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:19 devstack cinder-volume[75976]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Releasing lock "singleton_lock" {{(pid=75976) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:19 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Stop services. {{(pid=75976) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 16:01:19 devstack cinder-volume[75976]: DEBUG oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Killing children. {{(pid=75976) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 16:01:19 devstack cinder-volume[75976]: INFO oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Waiting on 1 children to exit Sep 28 16:01:24 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Acquiring lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:24 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Acquired lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:24 devstack cinder-volume[76133]: DEBUG oslo_concurrency.lockutils [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Releasing lock "singleton_lock" {{(pid=76133) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:24 devstack cinder-volume[76133]: WARNING amqp [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:01:24 devstack cinder-volume[76133]: WARNING amqp [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:01:24 devstack cinder-volume[75976]: INFO oslo_service.backend._eventlet.service [None req-7b153b26-82b7-46d6-af8f-1c9ab609b8d3 None None] Child 76133 exited with status 0 Sep 28 16:01:24 devstack cinder-volume[86287]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:01:24 devstack cinder-volume[86287]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:01:24 devstack cinder-volume[86287]: we strongly recommend against using it for new projects. Sep 28 16:01:24 devstack cinder-volume[86287]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:01:24 devstack cinder-volume[86287]: framework. For more detail see Sep 28 16:01:24 devstack cinder-volume[86287]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:01:24 devstack cinder-volume[86287]: import eventlet # noqa Sep 28 16:01:27 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:27 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:27 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:27 devstack cinder-volume[86287]: INFO dbcounter [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Registered counter for database cinder Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_db.sqlalchemy.engines [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG dbcounter [-] [86287] Writer thread running {{(pid=86287) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:01:28 devstack cinder-volume[86287]: INFO cinder.rpc [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:01:28 devstack cinder-volume[86287]: INFO cinder.rpc [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_db.sqlalchemy.engines [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:28 devstack cinder-volume[86287]: INFO cinder.volume.manager [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Determined volume DB was empty at startup. Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG cinder.volume.manager [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86287) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:01:28 devstack cinder-volume[86287]: INFO cinder.volume.manager [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 28 16:01:28 devstack cinder-volume[86287]: WARNING stevedore.named [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:01:28 devstack cinder-volume[86287]: WARNING castellan.key_manager [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:01:28 devstack cinder-volume[86287]: WARNING cinder.keymgr.conf_key_mgr [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:01:28 devstack cinder-volume[86287]: INFO cinder.volume.manager [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_db.sqlalchemy.engines [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86287) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:28 devstack cinder-volume[86287]: INFO oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Starting 1 workers Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Started child 86572 {{(pid=86287) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Full set of CONF: {{(pid=86287) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] ******************************************************************************** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Configuration options gathered from: {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] ================================================================================ {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] allow_availability_zone_fallback = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] allow_compression_on_image_upload = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] allowed_direct_url_schemes = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] api_rate_limit = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] auth_strategy = keystone {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_availability_zone = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_host = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_stats_polling_interval = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backup_api_class = cinder.backup.api.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backup_name_template = backup-%s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backup_use_same_host = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backup_use_temp_snapshot = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] chap_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] chap_username = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_internal_tenant_project_id = 148bcae3894e4b7fb40c29716f06c59a {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_internal_tenant_user_id = 2e3fd9bbcf8c4b4d84e3616a8898cabd {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cluster = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] compression_format = gzip {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86572]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] compute_api_class = cinder.compute.nova.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] config_dir = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] config_source = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] control_exchange = openstack {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] debug = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] default_availability_zone = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] default_group_type = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] default_volume_type = QuobyteHD {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] disk_geometry = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_client_cert = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_client_cert_key = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_data_namespace = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_ssl_cert_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_ssl_cert_verify = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] driver_use_ssl = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] enable_new_services = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] enable_unsupported_driver = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] enabled_backends = ['QuobyteHD'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] enforce_multipath_for_image_xfer = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] filter_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_api_insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_api_servers = ['http://192.168.122.162/image'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_api_ssl_compression = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_ca_certificates_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_catalog_info = image:glance:publicURL {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_num_retries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance_request_timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] goodness_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] graceful_shutdown_timeout = 5 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] group_api_class = cinder.group.api.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] host = devstack {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_compress_on_upload = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_conversion_address_space_limit = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_conversion_cpu_limit = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_conversion_disable = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_introspection_address_space_limit = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_introspection_cpu_limit = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_upload_use_cinder_backend = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_upload_use_internal_tenant = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_volume_cache_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_volume_cache_max_count = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] image_volume_cache_max_size_gb = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] init_host_max_objects_retrieval = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] instance_format = [instance: %(uuid)s] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iscsi_target_flags = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iscsi_write_cache = on {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iser_helper = tgtadm {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iser_ip_address = 192.168.122.162 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iser_port = 3260 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_color = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_config_append = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_dir = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_options = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_rotate_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_rotate_interval_type = days {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] log_rotation_type = none {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] max_age = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] max_logfile_count = 30 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] max_logfile_size_mb = 200 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] max_over_subscription_ratio = 20.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] message_reap_interval = 86400 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] message_ttl = 2592000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] migration_create_volume_timeout_secs = 300 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] monkey_patch = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] monkey_patch_modules = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] my_ip = 192.168.122.162 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] no_snapshot_gb_quota = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] num_iser_scan_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] num_shell_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] num_volume_device_scan_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] nvmeof_conn_info_version = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] nvmet_ns_id = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] nvmet_port_id = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_max_limit = 1000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_ext_list = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_listen_port = 8776 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_use_ssl = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] osapi_volume_workers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] per_volume_size_limit = -1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] periodic_fuzzy_delay = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] periodic_interval = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] public_endpoint = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] publish_errors = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_backup_gigabytes = 1000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_backups = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_gigabytes = 1000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_groups = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_snapshots = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] quota_volumes = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] rate_limit_burst = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] rate_limit_except_level = CRITICAL {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] rate_limit_interval = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] reinit_driver_count = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] replication_device = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] report_discard_supported = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] report_interval = 120 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] reservation_clean_interval = 86400 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] reservation_expire = 86400 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] reserved_image_namespaces = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] reserved_percentage = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] rpc_response_timeout = 120 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] run_external_periodic_tasks = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] scst_target_driver = iscsi {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] scst_target_iqn_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_down_time = 720 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] shell_completion = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] snapshot_name_template = snapshot-%s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] split_loggers = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] state_path = /opt/stack/data/cinder {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] storage_availability_zone = nova {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] storage_protocol = iSCSI {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] syslog_log_facility = LOG_USER {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_helper = lioadm {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_ip_address = 192.168.122.162 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_port = 3260 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_protocol = iscsi {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] target_secondary_ip_addresses = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] trace_flags = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] transport_url = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] until_refresh = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_chap_auth = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_default_quota_class = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_journal = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_json = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_multipath_for_image_xfer = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_stderr = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] use_syslog = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] verify_glance_signatures = enabled {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_api_class = cinder.volume.api.API {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_backend_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_clear = zero {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_clear_ionice = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_clear_size = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_copy_bps_limit = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_dd_blocksize = 1M {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_name_template = volume-%s {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_service_inithost_offload = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volume_usage_audit_period = month {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] zoning_mode = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:28 devstack cinder-volume[86572]: INFO cinder.volume.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_concurrency.disable_process_locking = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.remotefs [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86572) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.auth_section = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.auth_type = password {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.auth_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.cache = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.include_service_catalog = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.interface = public {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcache_username = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.region_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.service_type = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.backend = dogpile.cache.null {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.backend_argument = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.backend_expiration_time = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.config_prefix = cache.oslo {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.debug_cache_backend = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.enable_retry_client = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.enable_socket_keepalive = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.expiration_time = 600 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.hashclient_retry_attempts = 2 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_dead_retry = 300 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_pool_maxsize = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_sasl_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.proxies = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.redis_db = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.redis_server = localhost:6379 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.retry_attempts = 2 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.retry_delay = 0.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.socket_keepalive_count = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.socket_keepalive_idle = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.socket_keepalive_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.socket_timeout = 1.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.tls_allowed_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.tls_cafile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.tls_certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.tls_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.tls_keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cache.username = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] coordination.backend_url = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.asyncio_connection = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.asyncio_slave_connection = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.backend = sqlalchemy {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.connection = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.connection_debug = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.connection_parameters = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.connection_recycle_time = 3600 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.connection_trace = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.db_inc_retry_interval = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.db_max_retries = 20 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.db_max_retry_interval = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.db_retry_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.max_overflow = 50 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.max_pool_size = 5 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.max_retries = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.mysql_wsrep_sync_wait = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.pool_timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.retry_interval = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.slave_connection = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.sqlite_synchronous = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.synchronous_reader = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] database.use_db_reconnect = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_tracing.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.connection_string = messaging:// {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.es_doc_type = notification {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.es_scroll_size = 10000 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.es_scroll_time = 2m {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.filter_error_trace = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.hmac_keys = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.sentinel_service_name = mymaster {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.socket_timeout = 0.1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.trace_requests = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler.trace_sqlalchemy = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler_jaeger.process_tags = {} {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler_jaeger.service_name_prefix = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] profiler_otlp.service_name_prefix = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.enforce_new_defaults = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.policy_default_rule = default {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.policy_file = policy.yaml {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.group = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.helper_command = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] privsep_osbrick.user = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.group = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.helper_command = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] cinder_sys_admin.user = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.auth_section = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.auth_type = password {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.cafile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.collect_timing = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.send_service_user_token = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.split_loggers = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.tls_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] service_user.tls_min_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.auth_section = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.auth_type = password {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.collect_timing = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.region_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.split_loggers = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.tls_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] glance.tls_min_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.backend_availability_zone = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.chap_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.chap_username = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.disk_geometry = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_client_cert = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_client_cert_key = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_data_namespace = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.driver_use_ssl = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.extra_capabilities = {} {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.filter_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.goodness_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iscsi_target_flags = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iscsi_write_cache = on {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iser_helper = tgtadm {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iser_port = 3260 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_host = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_login = admin {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_mount_options = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_private_key = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_share_path = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.num_shell_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:28 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.quobyte_volume_url = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.replication_device = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.report_discard_supported = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.reserved_percentage = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_helper = tgtadm {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_port = 3260 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_protocol = iscsi {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.trace_flags = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.unique_fqdn_network = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.use_chap_auth = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_backend_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_clear = zero {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_clear_ionice = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86572) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_clear_size = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_reports.file_event_handler = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86572]: WARNING cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86572]: WARNING cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_reports.log_dir = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.backend_availability_zone = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.backend_host = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.chap_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.chap_username = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.chiscsi_conf = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.disk_geometry = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_client_cert = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_data_namespace = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.driver_use_ssl = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Running cmd (subprocess): mount.quobyte {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.extra_capabilities = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.filter_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.goodness_function = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iser_helper = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iser_ip_address = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iser_port = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.iser_target_prefix = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_host = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_login = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_mount_options = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_password = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_private_key = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_share_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_ssh_port = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.num_shell_tries = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.nvmet_port_id = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.replication_device = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.report_discard_supported = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.reserved_percentage = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.scst_target_driver = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.storage_protocol = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_helper = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_ip_address = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_port = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_prefix = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_protocol = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.trace_flags = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.use_chap_auth = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_clear = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_clear_size = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] QuobyteHD.volumes_dir = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_notifications.driver = [] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_notifications.retry = -1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] key_manager.fixed_key = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.barbican_api_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.barbican_endpoint = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.barbican_endpoint_type = public {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.barbican_region_name = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.cafile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.collect_timing = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.number_of_retries = 60 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.retry_delay = 1 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.send_service_user_token = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.split_loggers = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.tls_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.tls_min_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.verify_ssl = True {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican.verify_ssl_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.auth_section = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.auth_type = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.cafile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.certfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.collect_timing = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.insecure = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.keyfile = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.split_loggers = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.timeout = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.tls_ciphers = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] barbican_service_user.tls_min_version = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.approle_role_id = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.approle_secret_id = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.auth_method = approle {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.auth_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.kv_mountpoint = secret {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.kv_path = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.kv_version = 2 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.namespace = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.root_token_id = **** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.ssl_ca_crt_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.timeout = 60.0 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.token_file = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.token_role = None {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.use_ssl = False {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:29 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] ******************************************************************************** {{(pid=86287) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:01:29 devstack quobyte-client[86573]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 16:01:29 devstack quobyte-client[86573]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=86572) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:29 devstack cinder-volume[86572]: INFO cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 ... Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 -c /etc/quobyte/client-cinder.cfg {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:29 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 -c /etc/quobyte/client-cinder.cfg Sep 28 16:01:29 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:29 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.492s {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:29 devstack cinder-volume[86572]: INFO cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 succeeded Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=86572) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.512s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:29 devstack sudo[86679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:29 devstack sudo[86679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:29 devstack sudo[86679]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.304s {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:29 devstack cinder-volume[86572]: INFO cinder.volume.driver [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:01:29 devstack cinder-volume[86572]: DEBUG cinder.volume.driver [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.145206451416, 'free_capacity_gb': 1775.145206451416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86572) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_db.sqlalchemy.engines [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86572) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG dbcounter [-] [86572] Writer thread running {{(pid=86572) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.db.api [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Building query based on filter {{(pid=86572) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.image.image_utils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86572) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.keymgr.migration [None req-2bdd590d-dac5-4761-855e-59b935ef42cd None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=86572) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=86572) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:30 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:30 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:30 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.261s {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Notifying Schedulers of capabilities ... {{(pid=86572) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.volume.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Driver initialization completed successfully. Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Initiating service 3 cleanup Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Service 3 cleanup completed. Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.service [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Creating RPC server for service cinder-volume {{(pid=86572) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.service [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86572) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.volume.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=86572) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG cinder.volume.drivers.quobyte [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=86572) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86572) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:30 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:30 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:30 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:30 devstack cinder-volume[86572]: DEBUG oslo_concurrency.processutils [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.329s {{(pid=86572) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:30 devstack cinder-volume[86572]: INFO cinder.volume.manager [None req-12356a9c-e694-4ec9-9572-d439cf0f9d41 None None] Driver post RPC initialization completed successfully. Sep 28 16:01:34 devstack cinder-volume[86287]: INFO oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Caught SIGTERM, stopping children Sep 28 16:01:34 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Acquiring lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:34 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Acquired lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:34 devstack cinder-volume[86287]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Releasing lock "singleton_lock" {{(pid=86287) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:34 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Stop services. {{(pid=86287) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 28 16:01:34 devstack cinder-volume[86287]: DEBUG oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Killing children. {{(pid=86287) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 28 16:01:34 devstack cinder-volume[86287]: INFO oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Waiting on 1 children to exit Sep 28 16:01:38 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Acquiring lock "singleton_lock" {{(pid=86572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:38 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Acquired lock "singleton_lock" {{(pid=86572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:38 devstack cinder-volume[86572]: DEBUG oslo_concurrency.lockutils [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Releasing lock "singleton_lock" {{(pid=86572) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:38 devstack cinder-volume[86572]: WARNING amqp [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:01:38 devstack cinder-volume[86572]: WARNING amqp [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 28 16:01:38 devstack cinder-volume[86287]: INFO oslo_service.backend._eventlet.service [None req-8c9b1147-a8fe-45bb-80c5-8407ff241625 None None] Child 86572 exited with status 0 Sep 28 16:01:39 devstack cinder-volume[86891]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 28 16:01:39 devstack cinder-volume[86891]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:01:39 devstack cinder-volume[86891]: we strongly recommend against using it for new projects. Sep 28 16:01:39 devstack cinder-volume[86891]: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:01:39 devstack cinder-volume[86891]: framework. For more detail see Sep 28 16:01:39 devstack cinder-volume[86891]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:01:39 devstack cinder-volume[86891]: import eventlet # noqa Sep 28 16:01:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 28 16:01:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 28 16:01:42 devstack cinder-volume[86891]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86891) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 28 16:01:43 devstack cinder-volume[86891]: INFO dbcounter [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Registered counter for database cinder Sep 28 16:01:43 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:43 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writer thread running {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:01:43 devstack cinder-volume[86891]: INFO cinder.rpc [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 28 16:01:43 devstack cinder-volume[86891]: INFO cinder.rpc [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 28 16:01:43 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Determined volume DB was empty at startup. Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG cinder.volume.manager [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86891) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 28 16:01:44 devstack cinder-volume[86891]: WARNING stevedore.named [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 28 16:01:44 devstack cinder-volume[86891]: WARNING castellan.key_manager [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:01:44 devstack cinder-volume[86891]: WARNING cinder.keymgr.conf_key_mgr [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 28 16:01:44 devstack cinder-volume[86891]: INFO cinder.volume.manager [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_db.sqlalchemy.engines [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86891) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:44 devstack cinder-volume[86891]: INFO oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Starting 1 workers Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Started child 87150 {{(pid=86891) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Full set of CONF: {{(pid=86891) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] ******************************************************************************** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] Configuration options gathered from: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] ================================================================================ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] allow_availability_zone_fallback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] allow_compression_on_image_upload = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] allowed_direct_url_schemes = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] api_rate_limit = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] auth_strategy = keystone {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[87150]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_host = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_stats_polling_interval = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backup_api_class = cinder.backup.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backup_name_template = backup-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backup_use_same_host = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backup_use_temp_snapshot = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] chap_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] chap_username = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_internal_tenant_project_id = 148bcae3894e4b7fb40c29716f06c59a {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_internal_tenant_user_id = 2e3fd9bbcf8c4b4d84e3616a8898cabd {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cluster = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] compression_format = gzip {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] compute_api_class = cinder.compute.nova.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] config_dir = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] config_source = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] control_exchange = openstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] debug = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] default_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] default_group_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] default_volume_type = QuobyteHD {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] disk_geometry = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_client_cert = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_client_cert_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_data_namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_ssl_cert_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_ssl_cert_verify = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] driver_use_ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] enable_new_services = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] enable_unsupported_driver = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] enabled_backends = ['QuobyteHD'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] enforce_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] filter_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_api_insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_api_servers = ['http://192.168.122.162/image'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_api_ssl_compression = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_ca_certificates_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_catalog_info = image:glance:publicURL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_num_retries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance_request_timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] goodness_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] graceful_shutdown_timeout = 5 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] group_api_class = cinder.group.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] host = devstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_compress_on_upload = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_conversion_address_space_limit = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_conversion_cpu_limit = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_conversion_disable = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_introspection_address_space_limit = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_introspection_cpu_limit = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_upload_use_cinder_backend = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_upload_use_internal_tenant = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_volume_cache_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_volume_cache_max_count = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] image_volume_cache_max_size_gb = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] init_host_max_objects_retrieval = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] instance_format = [instance: %(uuid)s] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iscsi_target_flags = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iscsi_write_cache = on {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iser_helper = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iser_ip_address = 192.168.122.162 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iser_port = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_color = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_config_append = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_dir = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_options = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_rotate_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_rotate_interval_type = days {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] log_rotation_type = none {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] max_age = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] max_logfile_count = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] max_logfile_size_mb = 200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] max_over_subscription_ratio = 20.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] message_reap_interval = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] message_ttl = 2592000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] migration_create_volume_timeout_secs = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] monkey_patch = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] monkey_patch_modules = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] my_ip = 192.168.122.162 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] no_snapshot_gb_quota = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] num_iser_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] num_shell_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] num_volume_device_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] nvmeof_conn_info_version = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] nvmet_ns_id = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] nvmet_port_id = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_max_limit = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_ext_list = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_listen_port = 8776 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_use_ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] osapi_volume_workers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] per_volume_size_limit = -1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] periodic_fuzzy_delay = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] periodic_interval = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] public_endpoint = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] publish_errors = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_backup_gigabytes = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_backups = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_gigabytes = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_groups = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_snapshots = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] quota_volumes = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] rate_limit_burst = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] rate_limit_except_level = CRITICAL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] rate_limit_interval = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] reinit_driver_count = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] replication_device = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] report_discard_supported = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] report_interval = 120 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] reservation_clean_interval = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] reservation_expire = 86400 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] reserved_image_namespaces = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] reserved_percentage = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] rpc_response_timeout = 120 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] run_external_periodic_tasks = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] scst_target_driver = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] scst_target_iqn_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_down_time = 720 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Starting volume driver QuobyteDriver (1.2.1) Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] shell_completion = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] snapshot_name_template = snapshot-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] state_path = /opt/stack/data/cinder {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] storage_availability_zone = nova {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87150) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] storage_protocol = iSCSI {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] syslog_log_facility = LOG_USER {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_helper = lioadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_ip_address = 192.168.122.162 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_port = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_protocol = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] target_secondary_ip_addresses = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] trace_flags = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] transport_url = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] until_refresh = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_chap_auth = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_default_quota_class = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_journal = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_json = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_stderr = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] use_syslog = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] verify_glance_signatures = enabled {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_api_class = cinder.volume.api.API {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_backend_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_clear = zero {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_clear_ionice = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_clear_size = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_copy_bps_limit = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_dd_blocksize = 1M {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_name_template = volume-%s {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_service_inithost_offload = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volume_usage_audit_period = month {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] zoning_mode = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_concurrency.disable_process_locking = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.auth_type = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.auth_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.cache = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.include_service_catalog = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.interface = public {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcache_username = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.region_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.service_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.162/identity {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.backend = dogpile.cache.null {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.backend_argument = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.backend_expiration_time = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.config_prefix = cache.oslo {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.debug_cache_backend = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.enable_retry_client = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.enable_socket_keepalive = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.expiration_time = 600 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.hashclient_retry_attempts = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_dead_retry = 300 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_pool_maxsize = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_sasl_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.proxies = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.redis_db = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.redis_server = localhost:6379 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.retry_attempts = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.retry_delay = 0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.socket_keepalive_count = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.socket_keepalive_idle = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.socket_keepalive_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.socket_timeout = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.tls_allowed_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.tls_cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.tls_certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.tls_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.tls_keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cache.username = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] coordination.backend_url = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.asyncio_connection = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.asyncio_slave_connection = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.backend = sqlalchemy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.connection = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.connection_debug = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.connection_parameters = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.connection_recycle_time = 3600 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.connection_trace = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.db_inc_retry_interval = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.db_max_retries = 20 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.db_max_retry_interval = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.db_retry_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.max_overflow = 50 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.max_pool_size = 5 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.max_retries = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.mysql_wsrep_sync_wait = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.pool_timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.retry_interval = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.slave_connection = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.sqlite_synchronous = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.synchronous_reader = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] database.use_db_reconnect = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_tracing.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.connection_string = messaging:// {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.es_doc_type = notification {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.es_scroll_size = 10000 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.es_scroll_time = 2m {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.filter_error_trace = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.hmac_keys = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.sentinel_service_name = mymaster {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.socket_timeout = 0.1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.trace_requests = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler.trace_sqlalchemy = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler_jaeger.process_tags = {} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler_jaeger.service_name_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] profiler_otlp.service_name_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.enforce_new_defaults = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.policy_default_rule = default {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87150) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.policy_file = policy.yaml {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.group = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.helper_command = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Running cmd (subprocess): mount.quobyte {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] privsep_osbrick.user = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.group = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.helper_command = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] cinder_sys_admin.user = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.auth_type = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.collect_timing = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.send_service_user_token = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.tls_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] service_user.tls_min_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.auth_type = password {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.collect_timing = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.region_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.tls_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] glance.tls_min_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.backend_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.chap_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.chap_username = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.disk_geometry = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_client_cert = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_client_cert_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_data_namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.driver_use_ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.extra_capabilities = {} {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.filter_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.goodness_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iscsi_target_flags = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iscsi_write_cache = on {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iser_helper = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iser_ip_address = 192.168.122.162 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iser_port = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_host = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_login = admin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_mount_options = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_private_key = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_share_path = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.num_shell_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.quobyte_volume_url = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.replication_device = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.report_discard_supported = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.reserved_percentage = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_helper = tgtadm {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_ip_address = 192.168.122.162 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_port = 3260 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_protocol = iscsi {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.trace_flags = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.unique_fqdn_network = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.use_chap_auth = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_backend_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_clear = zero {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_clear_ionice = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_clear_size = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_reports.file_event_handler = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_reports.log_dir = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.backend_availability_zone = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.backend_host = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.chap_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.chap_username = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.chiscsi_conf = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.disk_geometry = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_client_cert = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_data_namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.driver_use_ssl = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.extra_capabilities = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.filter_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.goodness_function = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack quobyte-client[87151]: Reading configuration file: /etc/quobyte/client.cfg Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iser_helper = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iser_ip_address = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iser_port = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.iser_target_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_host = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack quobyte-client[87151]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] CMD "mount.quobyte" returned: 1 in 0.054s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_login = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_mount_options = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_password = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_private_key = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_share_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_ssh_port = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.num_shell_tries = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.nvmet_port_id = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.replication_device = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.report_discard_supported = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.reserved_percentage = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.scst_target_driver = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.storage_protocol = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_helper = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_ip_address = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_port = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_prefix = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_protocol = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.trace_flags = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.use_chap_auth = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_clear = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_clear_size = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] QuobyteHD.volumes_dir = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_notifications.driver = [] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_notifications.retry = -1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] key_manager.fixed_key = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.barbican_api_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.barbican_endpoint = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.barbican_endpoint_type = public {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.barbican_region_name = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.collect_timing = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack sudo[87152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.number_of_retries = 60 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.retry_delay = 1 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.send_service_user_token = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.tls_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.tls_min_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack sudo[87152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.verify_ssl = True {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican.verify_ssl_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.auth_section = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.auth_type = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.cafile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.certfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.collect_timing = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.insecure = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.keyfile = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.split_loggers = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.timeout = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.tls_ciphers = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] barbican_service_user.tls_min_version = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.approle_role_id = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.approle_secret_id = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.auth_method = approle {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.auth_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.kv_mountpoint = secret {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.kv_path = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.kv_version = 2 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.namespace = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.root_token_id = **** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.ssl_ca_crt_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.timeout = 60.0 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.token_file = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.token_role = None {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.use_ssl = False {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 28 16:01:44 devstack cinder-volume[86891]: DEBUG oslo_service.backend._eventlet.service [None req-1487f24f-0628-40a4-bd16-5d05e02f8c91 None None] ******************************************************************************** {{(pid=86891) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 28 16:01:44 devstack sudo[87152]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:44 devstack cinder-volume[87150]: INFO cinder.volume.driver [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Driver hasn't implemented _init_vendor_properties() Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.driver [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.145206451416, 'free_capacity_gb': 1775.145206451416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_db.sqlalchemy.engines [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87150) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writer thread running {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.db.api [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Building query based on filter {{(pid=87150) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87150) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:44 devstack cinder-volume[87150]: INFO cinder.keymgr.migration [None req-f6a72655-c8cf-445a-b1e4-1e55ef028f1b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 28 16:01:44 devstack sudo[87171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:44 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:45 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:01:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Driver initialization completed successfully. Sep 28 16:01:45 devstack cinder-volume[87150]: INFO cinder.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Initiating service 3 cleanup Sep 28 16:01:45 devstack cinder-volume[87150]: INFO cinder.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Service 3 cleanup completed. Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG cinder.service [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Creating RPC server for service cinder-volume {{(pid=87150) start /opt/stack/cinder/cinder/service.py:231}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG cinder.service [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87150) start /opt/stack/cinder/cinder/service.py:237}} Sep 28 16:01:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:01:45 devstack sudo[87197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:01:45 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:01:45 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root Sep 28 16:01:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:01:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-19c99fe7-0829-4b8f-adc5-8c166a02c0bc None None] Driver post RPC initialization completed successfully. Sep 28 16:01:54 devstack cinder-volume[86891]: DEBUG dbcounter [-] [86891] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86891) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:54 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:01:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:02:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:02:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 6 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:02:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Flow 'volume_create_manager' (e16bae41-b103-4182-abed-c4e35f19e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb651e9-f3c1-4c89-89b2-687a2ce62288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb651e9-f3c1-4c89-89b2-687a2ce62288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1761965987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedd22af-d1cd-4f94-acd2-27bac51f91d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef53adfefcf34a07b407eb5de1499fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:24Z,use_quota=True,user_id='c4707aec5d9c4bc6965dcd4a30691b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024a10a3-93c7-4726-b371-a1f761a19ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (024a10a3-93c7-4726-b371-a1f761a19ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e962082-6b5d-4449-ad95-816bad14330f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e962082-6b5d-4449-ad95-816bad14330f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eedd22af-d1cd-4f94-acd2-27bac51f91d6', 'volume_name': 'volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5eeb1b-4e77-4e79-baf0-eb49de273878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5eeb1b-4e77-4e79-baf0-eb49de273878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b5fd0f-bbfd-4094-8e9c-424c6f7577bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Volume eedd22af-d1cd-4f94-acd2-27bac51f91d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6', 'volume_size': 1} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1761965987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eedd22af-d1cd-4f94-acd2-27bac51f91d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef53adfefcf34a07b407eb5de1499fda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:24Z,use_quota=True,user_id='c4707aec5d9c4bc6965dcd4a30691b52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Creating volume eedd22af-d1cd-4f94-acd2-27bac51f91d6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:03:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:24 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 1073741824 Sep 28 16:03:24 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:25 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 1073741824" returned: 0 in 1.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:25 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 Sep 28 16:03:25 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:25 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9b5fd0f-bbfd-4094-8e9c-424c6f7577bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9c7aea-6ec0-4355-9ebf-f72c44eb9d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Volume volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 (eedd22af-d1cd-4f94-acd2-27bac51f91d6): created successfully Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed9c7aea-6ec0-4355-9ebf-f72c44eb9d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Flow 'volume_create_manager' (e16bae41-b103-4182-abed-c4e35f19e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5527fad6-420a-42b5-9d7d-b3e6781d89cc tempest-VolumesAdminNegativeTest-880814286 None] Created volume successfully. Sep 28 16:03:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Acquiring lock "cinder-eedd22af-d1cd-4f94-acd2-27bac51f91d6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "cinder-eedd22af-d1cd-4f94-acd2-27bac51f91d6-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Acquiring lock "cinder-quobyte-eedd22af-d1cd-4f94-acd2-27bac51f91d6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:03:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "cinder-quobyte-eedd22af-d1cd-4f94-acd2-27bac51f91d6" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:03:27 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy4ql6oxo/privsep.sock'] Sep 28 16:03:27 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy4ql6oxo/privsep.sock Sep 28 16:03:27 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: Sep 28 16:03:30 devstack cinder-volume[87150]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 28 16:03:30 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:30 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Spawned new privsep daemon via rootwrap Sep 28 16:03:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Accepted privsep connection to /tmp/tmpy4ql6oxo/privsep.sock {{(pid=87150) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 28 16:03:30 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 28 16:03:30 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 28 16:03:30 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 28 16:03:30 devstack cinder-volume[87150]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88208 Sep 28 16:03:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe3ccac-4d91-4b5c-ade8-15b40ecdcf61]: (2,) {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1aa34-922e-464c-a07b-41892a3a9475]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:03:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:30 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 Sep 28 16:03:30 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:31 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6" returned: 0 in 0.661s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:31 devstack sudo[88263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6 Sep 28 16:03:31 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:31 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-eedd22af-d1cd-4f94-acd2-27bac51f91d6" returned: 0 in 0.503s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "cinder-quobyte-eedd22af-d1cd-4f94-acd2-27bac51f91d6" released by "delete_volume" :: held 4.005s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:31 devstack cinder-volume[87150]: WARNING cinder.quota [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:03:31 devstack cinder-volume[87150]: WARNING cinder.quota [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:03:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Created reservations ['bfeb11c5-303c-4cdb-af06-9ec1257bd29b', 'd59e2b86-562d-428d-8fe4-a3bac30649ba', '597f906d-f76f-4280-b612-3b1e82db1821', '890d4f02-b6d7-4618-801f-fd1fd6f29f8b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:32 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:03:32 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:32 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Deleted volume successfully. Sep 28 16:03:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1e24f80-4abd-4606-9985-37456994a1d8 tempest-VolumesAdminNegativeTest-880814286 None] Lock "cinder-eedd22af-d1cd-4f94-acd2-27bac51f91d6-delete_volume" released by "delete_volume" :: held 4.773s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:36 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:03:36 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:36 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.361s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 8 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:03:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:03:42 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:42 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:UPDATE=11,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (f123c83e-45e1-4ae5-9c85-95996d27269b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3723040f-44fd-462f-95ac-1704ea2708a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3723040f-44fd-462f-95ac-1704ea2708a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1208966224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b656424-def6-480c-a719-7af826d9a48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:54Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0884ba-7ec0-4dc9-b55a-d3647c84e78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf0884ba-7ec0-4dc9-b55a-d3647c84e78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f3a277-3ee0-4388-9843-237b6d56a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65f3a277-3ee0-4388-9843-237b6d56a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b656424-def6-480c-a719-7af826d9a48b', 'volume_name': 'volume-9b656424-def6-480c-a719-7af826d9a48b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd348af6-68d4-4e3d-bf14-28c5208dcd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd348af6-68d4-4e3d-bf14-28c5208dcd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021a85e6-6b17-4bb6-93ed-927f630360ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Volume 9b656424-def6-480c-a719-7af826d9a48b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b656424-def6-480c-a719-7af826d9a48b', 'volume_size': 1} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1208966224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b656424-def6-480c-a719-7af826d9a48b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:54Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Creating volume 9b656424-def6-480c-a719-7af826d9a48b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:54 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b 1073741824 Sep 28 16:03:54 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Flow 'volume_create_manager' (be5ebabf-47a9-475d-a0c0-980c0c9b736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a260a04-ec44-4f9e-84fa-517789a279f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a260a04-ec44-4f9e-84fa-517789a279f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1904275577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb64d395f414869ac15f12b9398ac1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:55Z,use_quota=True,user_id='67989c7d734447d2a12364ae85d3f2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5140d739-d6c8-4697-8b90-b2bf10bbff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5140d739-d6c8-4697-8b90-b2bf10bbff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b028281-031a-411d-865d-a5c89d0ccefd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b028281-031a-411d-865d-a5c89d0ccefd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'volume_name': 'volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9624610f-f187-4800-9f5c-652c501c8a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9624610f-f187-4800-9f5c-652c501c8a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31ff4f3-39c3-4854-b69f-b1a80ce03ee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Volume f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'volume_size': 1} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b 1073741824" returned: 0 in 0.683s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:54 devstack sudo[88374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b Sep 28 16:03:54 devstack sudo[88374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:55 devstack sudo[88374]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b" returned: 0 in 0.404s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.460s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:03:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1904275577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb64d395f414869ac15f12b9398ac1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:03:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:03:55Z,use_quota=True,user_id='67989c7d734447d2a12364ae85d3f2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Creating volume f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:03:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:55 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d 1073741824 Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021a85e6-6b17-4bb6-93ed-927f630360ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b656424-def6-480c-a719-7af826d9a48b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:55 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec08307-96c3-450d-896f-9cc9c1b7c767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Volume volume-9b656424-def6-480c-a719-7af826d9a48b (9b656424-def6-480c-a719-7af826d9a48b): created successfully Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec08307-96c3-450d-896f-9cc9c1b7c767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (f123c83e-45e1-4ae5-9c85-95996d27269b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d6a3a614-c700-4968-8654-bd18877491ec tempest-AttachVolumeNegativeTest-2143169128 None] Created volume successfully. Sep 28 16:03:56 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d 1073741824" returned: 0 in 0.804s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:03:56 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d Sep 28 16:03:56 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:03:56 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" returned: 0 in 0.664s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31ff4f3-39c3-4854-b69f-b1a80ce03ee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda1e4f8-5f5e-4fa3-b826-9da6ff4a6759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:03:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Volume volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d (f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d): created successfully Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda1e4f8-5f5e-4fa3-b826-9da6ff4a6759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:03:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Flow 'volume_create_manager' (be5ebabf-47a9-475d-a0c0-980c0c9b736b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:03:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a0223196-bfc7-4ac7-a57d-ee07120bad15 tempest-ServerActionsTestOtherA-2122357938 None] Created volume successfully. Sep 28 16:04:01 devstack cinder-volume[87150]: WARNING py.warnings [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 28 16:04:01 devstack cinder-volume[87150]: .first() Sep 28 16:04:01 devstack cinder-volume[87150]: Sep 28 16:04:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-9b656424-def6-480c-a719-7af826d9a48b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9741233-b0af-4d31-905e-0c6d334d201d', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:04:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-ab19720f-9359-4d53-a13c-22ef2dfcbb47 req-68c869cc-194d-4b34-838f-3d7d5929070e tempest-AttachVolumeNegativeTest-2143169128 None] attachment_update completed successfully. Sep 28 16:04:12 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:12 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=7,cinder:SELECT=9,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:36 devstack sudo[89328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:04:36 devstack sudo[89328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:37 devstack sudo[89328]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.830s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:04:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:04:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 8 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:04:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:04:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5777fb4b-2331-467e-9f6b-0aa2cf4550bf req-b12d9238-c000-43b3-8c5c-769fd49b43e5 tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5777fb4b-2331-467e-9f6b-0aa2cf4550bf req-b12d9238-c000-43b3-8c5c-769fd49b43e5 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5777fb4b-2331-467e-9f6b-0aa2cf4550bf req-b12d9238-c000-43b3-8c5c-769fd49b43e5 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.062s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-5777fb4b-2331-467e-9f6b-0aa2cf4550bf req-b12d9238-c000-43b3-8c5c-769fd49b43e5 tempest-ServerActionsTestOtherA-2122357938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9193142-56b8-4a89-ab7e-d778eb6a7c3a', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:04:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-5777fb4b-2331-467e-9f6b-0aa2cf4550bf req-b12d9238-c000-43b3-8c5c-769fd49b43e5 tempest-ServerActionsTestOtherA-2122357938 None] attachment_update completed successfully. Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Flow 'volume_create_manager' (7834fe0f-5cba-48bc-a5ac-f7754fd72dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72582076-b79a-429b-8d1c-9c7dedb6be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72582076-b79a-429b-8d1c-9c7dedb6be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1636612510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d661ea-c8cf-42c4-b15c-086b78b5da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41d3d3f9da4e75866ac0ee505d3909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:52Z,use_quota=True,user_id='a9c9ba9a13794b37af477637ca38e5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876007db-4abd-4a0f-a185-5e357a753de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876007db-4abd-4a0f-a185-5e357a753de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1de791a-2624-4284-8e1f-330605f97366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1de791a-2624-4284-8e1f-330605f97366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d661ea-c8cf-42c4-b15c-086b78b5da84', 'volume_name': 'volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0928c03-9170-44a7-ad1a-ee2375b09834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0928c03-9170-44a7-ad1a-ee2375b09834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e320eb91-3c46-4d98-bb1a-481d61ae917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Volume c8d661ea-c8cf-42c4-b15c-086b78b5da84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84', 'volume_size': 1} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1636612510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d661ea-c8cf-42c4-b15c-086b78b5da84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41d3d3f9da4e75866ac0ee505d3909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:52Z,use_quota=True,user_id='a9c9ba9a13794b37af477637ca38e5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Creating volume c8d661ea-c8cf-42c4-b15c-086b78b5da84 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:04:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:51 devstack sudo[89584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 1073741824 Sep 28 16:04:51 devstack sudo[89584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:53 devstack sudo[89584]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 1073741824" returned: 0 in 1.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:53 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 Sep 28 16:04:53 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:54 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84" returned: 0 in 0.593s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.267s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e320eb91-3c46-4d98-bb1a-481d61ae917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6288f053-7d1c-4a10-95aa-400c6dec8c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Volume volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 (c8d661ea-c8cf-42c4-b15c-086b78b5da84): created successfully Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6288f053-7d1c-4a10-95aa-400c6dec8c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Flow 'volume_create_manager' (7834fe0f-5cba-48bc-a5ac-f7754fd72dc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-41205ff6-a45a-4b64-9f11-5a9c67b6c040 tempest-ServersNegativeTestJSON-1629619485 None] Created volume successfully. Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Flow 'volume_create_manager' (fe5ac044-2718-4f70-817b-0b21d6a78bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3c05e6-bc3a-4500-a0a4-22a5a33a8e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3c05e6-bc3a-4500-a0a4-22a5a33a8e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-89227406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e20ce1-d785-43bf-bed0-cee2e94c8770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee75aa8b08f4dc897a1f5ecc6fc538c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:54Z,use_quota=True,user_id='36ddc795437c466f951603cf622286cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a42cec2-aedc-49ed-b2a8-cf5a469f626d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a42cec2-aedc-49ed-b2a8-cf5a469f626d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1e3d14-c8aa-4f73-83e9-52f5801d8604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1e3d14-c8aa-4f73-83e9-52f5801d8604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0e20ce1-d785-43bf-bed0-cee2e94c8770', 'volume_name': 'volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae99926-97bd-4c1c-a950-dda491901ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae99926-97bd-4c1c-a950-dda491901ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fba677-db32-40a9-8f3c-99f2d7541670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Volume e0e20ce1-d785-43bf-bed0-cee2e94c8770: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770', 'volume_size': 1} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-89227406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0e20ce1-d785-43bf-bed0-cee2e94c8770,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aee75aa8b08f4dc897a1f5ecc6fc538c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:54Z,use_quota=True,user_id='36ddc795437c466f951603cf622286cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Creating volume e0e20ce1-d785-43bf-bed0-cee2e94c8770 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:04:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:54 devstack sudo[89621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 1073741824 Sep 28 16:04:54 devstack sudo[89621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:55 devstack sudo[89621]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 1073741824" returned: 0 in 1.024s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:55 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 Sep 28 16:04:55 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:56 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770" returned: 0 in 0.444s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fba677-db32-40a9-8f3c-99f2d7541670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51eeda-23f8-40c7-b3df-f0b3c2023eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Volume volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 (e0e20ce1-d785-43bf-bed0-cee2e94c8770): created successfully Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51eeda-23f8-40c7-b3df-f0b3c2023eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Flow 'volume_create_manager' (fe5ac044-2718-4f70-817b-0b21d6a78bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7981a885-6ff0-4c81-bd20-bffc94283969 tempest-DeleteServersTestJSON-502055114 None] Created volume successfully. Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Flow 'volume_create_manager' (45998b5b-d363-4111-b06b-41b91ad80fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f569f-aac6-4467-ae66-6ab3425a82bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e8f569f-aac6-4467-ae66-6ab3425a82bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1116344558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32fa373-2229-4470-b13f-81f2d44a62ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41d3d3f9da4e75866ac0ee505d3909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:57Z,use_quota=True,user_id='a9c9ba9a13794b37af477637ca38e5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541193c0-d3ee-4e20-a3ab-97a9049e4678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (541193c0-d3ee-4e20-a3ab-97a9049e4678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a4cbe7-4a32-4b53-ad69-c5c737b1f87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57a4cbe7-4a32-4b53-ad69-c5c737b1f87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b32fa373-2229-4470-b13f-81f2d44a62ad', 'volume_name': 'volume-b32fa373-2229-4470-b13f-81f2d44a62ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c156fe3b-d0a5-4679-b00c-faed9ff1e9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c156fe3b-d0a5-4679-b00c-faed9ff1e9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e9ac85-08a0-41b6-8083-d77acc9b3eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Volume b32fa373-2229-4470-b13f-81f2d44a62ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b32fa373-2229-4470-b13f-81f2d44a62ad', 'volume_size': 1} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1116344558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b32fa373-2229-4470-b13f-81f2d44a62ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc41d3d3f9da4e75866ac0ee505d3909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:04:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:04:57Z,use_quota=True,user_id='a9c9ba9a13794b37af477637ca38e5b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Creating volume b32fa373-2229-4470-b13f-81f2d44a62ad {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:04:57 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:57 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad 1073741824 Sep 28 16:04:57 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-9a9786ca-b82c-45d6-815c-f60f32b1f568 tempest-ServerActionsTestOtherA-2122357938 None] Terminate volume connection completed successfully. Sep 28 16:04:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-9a9786ca-b82c-45d6-815c-f60f32b1f568 tempest-ServerActionsTestOtherA-2122357938 None] Deleting attachment c9193142-56b8-4a89-ab7e-d778eb6a7c3a. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9d7b24cf-c839-4c02-9bd7-1a7ba1033b94 req-016819d2-c71c-47fa-997d-caf3a96fd116 tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:58 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad 1073741824" returned: 0 in 0.785s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:04:58 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad Sep 28 16:04:58 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:04:58 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] <== create_volume: return (1377ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9d7b24cf-c839-4c02-9bd7-1a7ba1033b94 req-016819d2-c71c-47fa-997d-caf3a96fd116 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.781s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e9ac85-08a0-41b6-8083-d77acc9b3eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b32fa373-2229-4470-b13f-81f2d44a62ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4892a0-45f6-4058-b3c0-1bb59ac50621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9d7b24cf-c839-4c02-9bd7-1a7ba1033b94 req-016819d2-c71c-47fa-997d-caf3a96fd116 tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Volume volume-b32fa373-2229-4470-b13f-81f2d44a62ad (b32fa373-2229-4470-b13f-81f2d44a62ad): created successfully Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d4892a0-45f6-4058-b3c0-1bb59ac50621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:04:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Flow 'volume_create_manager' (45998b5b-d363-4111-b06b-41b91ad80fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:04:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a0ee5757-db2a-41f4-aa87-04b396c6c0d9 tempest-ServersNegativeTestJSON-1629619485 None] Created volume successfully. Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9d7b24cf-c839-4c02-9bd7-1a7ba1033b94 req-016819d2-c71c-47fa-997d-caf3a96fd116 tempest-DeleteServersTestJSON-502055114 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '173b674e-d54a-4ca4-a53b-60f9aadec89e', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-c3662a21-e7a7-4876-9885-73fb1bd7d3ae tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-c3662a21-e7a7-4876-9885-73fb1bd7d3ae tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-c3662a21-e7a7-4876-9885-73fb1bd7d3ae tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:04:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9d7b24cf-c839-4c02-9bd7-1a7ba1033b94 req-016819d2-c71c-47fa-997d-caf3a96fd116 tempest-DeleteServersTestJSON-502055114 None] attachment_update completed successfully. Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-c3662a21-e7a7-4876-9885-73fb1bd7d3ae tempest-ServerActionsTestOtherA-2122357938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '985dbeb2-38cb-4afe-8f78-50279101ec23', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:04:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-455d3fd2-ec09-4ab4-b1cf-757f8d32d9ca req-c3662a21-e7a7-4876-9885-73fb1bd7d3ae tempest-ServerActionsTestOtherA-2122357938 None] attachment_update completed successfully. Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "cinder-b32fa373-2229-4470-b13f-81f2d44a62ad-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:04:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-b32fa373-2229-4470-b13f-81f2d44a62ad-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "cinder-quobyte-b32fa373-2229-4470-b13f-81f2d44a62ad" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-quobyte-b32fa373-2229-4470-b13f-81f2d44a62ad" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac438496-8934-4e62-9095-cfcfdbbd62ef]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:00 devstack sudo[89709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad Sep 28 16:05:00 devstack sudo[89709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:00 devstack sudo[89709]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad" returned: 0 in 0.869s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:01 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad Sep 28 16:05:01 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:01 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b32fa373-2229-4470-b13f-81f2d44a62ad" returned: 0 in 0.497s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-quobyte-b32fa373-2229-4470-b13f-81f2d44a62ad" released by "delete_volume" :: held 1.486s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Created reservations ['92972153-7381-4693-ab43-e6a48b931142', '133c8a1c-35fa-4421-b3d0-8872c888de7e', '5d2c6561-f789-4000-99d1-52150b20baf2', '6739d458-eb7a-4840-8e90-581fbedbcd6a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:05:02 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "cinder-c8d661ea-c8cf-42c4-b15c-086b78b5da84-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-c8d661ea-c8cf-42c4-b15c-086b78b5da84-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "cinder-quobyte-c8d661ea-c8cf-42c4-b15c-086b78b5da84" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-quobyte-c8d661ea-c8cf-42c4-b15c-086b78b5da84" acquired by "delete_volume" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c95fdc-992e-4507-bc98-73f1ba778d7a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:02 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.774s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Deleted volume successfully. Sep 28 16:05:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b84ed132-bf1a-42e2-98fb-dfd3abc3db5f tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-b32fa373-2229-4470-b13f-81f2d44a62ad-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:02 devstack sudo[89774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 Sep 28 16:05:02 devstack sudo[89774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:03 devstack sudo[89774]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84" returned: 0 in 0.861s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:03 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84 Sep 28 16:05:03 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:04 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c8d661ea-c8cf-42c4-b15c-086b78b5da84" returned: 0 in 0.536s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-quobyte-c8d661ea-c8cf-42c4-b15c-086b78b5da84" released by "delete_volume" :: held 1.501s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Created reservations ['c93fce11-3a54-4723-8d1e-8c3ffa884697', 'dc30a8fa-ae71-44e8-bc6e-80b22a291f77', '78f55ae3-18db-4a2e-853c-091423ae48d1', '16b8d607-2796-42bd-bee0-58bccdb00507'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:04 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:05:04 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:04 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.372s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Deleted volume successfully. Sep 28 16:05:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15542bc0-55df-4738-9d34-5dee35d5bdb0 tempest-ServersNegativeTestJSON-1629619485 None] Lock "cinder-c8d661ea-c8cf-42c4-b15c-086b78b5da84-delete_volume" released by "delete_volume" :: held 2.358s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-c22c63d4-c3c5-452d-a462-3f436593be73 req-828e684a-073a-4595-b7d6-d663171081ca tempest-DeleteServersTestJSON-502055114 None] Terminate volume connection completed successfully. Sep 28 16:05:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-c22c63d4-c3c5-452d-a462-3f436593be73 req-828e684a-073a-4595-b7d6-d663171081ca tempest-DeleteServersTestJSON-502055114 None] Deleting attachment 173b674e-d54a-4ca4-a53b-60f9aadec89e. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "cinder-e0e20ce1-d785-43bf-bed0-cee2e94c8770-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "cinder-e0e20ce1-d785-43bf-bed0-cee2e94c8770-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "cinder-quobyte-e0e20ce1-d785-43bf-bed0-cee2e94c8770" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "cinder-quobyte-e0e20ce1-d785-43bf-bed0-cee2e94c8770" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3ca2d4-91e0-4d0b-b92e-9685a93be19d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:05:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:09 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 Sep 28 16:05:09 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:09 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770" returned: 0 in 0.669s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:09 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770 Sep 28 16:05:09 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:10 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e0e20ce1-d785-43bf-bed0-cee2e94c8770" returned: 0 in 0.970s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "cinder-quobyte-e0e20ce1-d785-43bf-bed0-cee2e94c8770" released by "delete_volume" :: held 1.793s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Created reservations ['697e2d1e-8604-446a-8203-b93ce9cfb4b2', '261b8bde-5ba2-4513-bb11-01fc7a8b2f47', 'd2f0bb1d-f64f-4dd4-b928-a96d9fb14339', '7ff89f8c-9b52-4442-b61e-1a6d6f38415e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:11 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:05:11 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:11 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Deleted volume successfully. Sep 28 16:05:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-655bfc91-3126-4040-b5da-e3e797b4de7e tempest-DeleteServersTestJSON-502055114 None] Lock "cinder-e0e20ce1-d785-43bf-bed0-cee2e94c8770-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:05:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9d52aed7-a680-45af-a689-e27ecbd68cfc req-77165a7a-9d8a-49f5-9714-a580d71fff06 tempest-AttachVolumeNegativeTest-2143169128 None] Terminate volume connection completed successfully. Sep 28 16:05:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9d52aed7-a680-45af-a689-e27ecbd68cfc req-77165a7a-9d8a-49f5-9714-a580d71fff06 tempest-AttachVolumeNegativeTest-2143169128 None] Deleting attachment e9741233-b0af-4d31-905e-0c6d334d201d. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:30 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=45,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:30 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=42,cinder:UPDATE=39,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:36 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:05:36 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:36 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:05:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-e2ce1f2b-1e54-4388-8c90-7bd8dd7e8bc2 req-047f0ec3-bb24-4748-8eec-3f2e8a42da11 tempest-ServerActionsTestOtherA-2122357938 None] Terminate volume connection completed successfully. Sep 28 16:05:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-e2ce1f2b-1e54-4388-8c90-7bd8dd7e8bc2 req-047f0ec3-bb24-4748-8eec-3f2e8a42da11 tempest-ServerActionsTestOtherA-2122357938 None] Deleting attachment 985dbeb2-38cb-4afe-8f78-50279101ec23. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:05:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Flow 'volume_create_manager' (3d24d14f-cb1c-446f-963e-8c152276c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef83bb41-1322-414b-b90b-93c9e26714f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef83bb41-1322-414b-b90b-93c9e26714f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1320274614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be98ca42-6d74-4cf8-bd5a-27b99b086e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc88d4a05a714e909a2d677770ed5cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:59Z,use_quota=True,user_id='e0607a1db47a4acbb8c1ddb77564431e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec1f00d-c7fd-43e6-b90e-f1d80ac8e8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec1f00d-c7fd-43e6-b90e-f1d80ac8e8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8423d156-0be9-42ed-b073-90992a1f3a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8423d156-0be9-42ed-b073-90992a1f3a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be98ca42-6d74-4cf8-bd5a-27b99b086e8e', 'volume_name': 'volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1935efb-1f20-47f5-9bba-c53b02e25e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1935efb-1f20-47f5-9bba-c53b02e25e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a856e60-943b-463f-8c9b-7aabff11c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:05:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Volume be98ca42-6d74-4cf8-bd5a-27b99b086e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e', 'volume_size': 1} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:05:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1320274614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be98ca42-6d74-4cf8-bd5a-27b99b086e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc88d4a05a714e909a2d677770ed5cfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:05:59Z,use_quota=True,user_id='e0607a1db47a4acbb8c1ddb77564431e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Creating volume be98ca42-6d74-4cf8-bd5a-27b99b086e8e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:05:59 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:59 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e 1073741824 Sep 28 16:05:59 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:05:59 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e 1073741824" returned: 0 in 0.681s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:05:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:05:59 devstack sudo[90119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e Sep 28 16:05:59 devstack sudo[90119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:00 devstack sudo[90119]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a856e60-943b-463f-8c9b-7aabff11c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23190fc0-691e-4838-b3e0-92095883d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Volume volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e (be98ca42-6d74-4cf8-bd5a-27b99b086e8e): created successfully Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23190fc0-691e-4838-b3e0-92095883d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Flow 'volume_create_manager' (3d24d14f-cb1c-446f-963e-8c152276c461) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fca288c0-139e-4c12-a380-f128b58f8280 tempest-TaggedAttachmentsTest-1791171013 None] Created volume successfully. Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Flow 'volume_create_manager' (cbf84bfa-5689-4c4a-a4d0-1383c8484593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724e905c-1480-4d17-9b10-b9989460c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (724e905c-1480-4d17-9b10-b9989460c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1248595831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bba0f3-0764-45a3-8c52-24ec8367a69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb64d395f414869ac15f12b9398ac1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:02Z,use_quota=True,user_id='67989c7d734447d2a12364ae85d3f2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b56623d-3580-4216-8bde-861e4c8be1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b56623d-3580-4216-8bde-861e4c8be1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58386109-dbc4-4282-a8c4-a517afbb64c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58386109-dbc4-4282-a8c4-a517afbb64c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '15bba0f3-0764-45a3-8c52-24ec8367a69d', 'volume_name': 'volume-15bba0f3-0764-45a3-8c52-24ec8367a69d', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1cfe5f-328b-4741-ae1f-7cb8814c421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1cfe5f-328b-4741-ae1f-7cb8814c421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13156c8-6478-4a82-93b4-a25e0445af10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Volume 15bba0f3-0764-45a3-8c52-24ec8367a69d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-15bba0f3-0764-45a3-8c52-24ec8367a69d', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:06:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Trying to clone 15bba0f3-0764-45a3-8c52-24ec8367a69d from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:06:03 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:06:03 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:06:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1142a31-5c44-4107-a6ac-8fe9537f42c6]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:03 devstack sudo[90157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD Sep 28 16:06:03 devstack sudo[90157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:04 devstack sudo[90157]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b is fetched for user 67989c7d734447d2a12364ae85d3f2c7. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5730651a-a703-4bdc-b3bf-35a6ccf100ef]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:04 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD Sep 28 16:06:04 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:04 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1248595831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15bba0f3-0764-45a3-8c52-24ec8367a69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb64d395f414869ac15f12b9398ac1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:02Z,use_quota=True,user_id='67989c7d734447d2a12364ae85d3f2c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Creating volume 15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:04 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:06:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:04 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1073741824 Sep 28 16:06:04 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:05 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1073741824" returned: 0 in 0.713s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:05 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d Sep 28 16:06:05 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:06 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Attempting download of 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume 15bba0f3-0764-45a3-8c52-24ec8367a69d. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ea7367-0614-4550-bf2d-0ab9fe323e39]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:06 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p Sep 28 16:06:06 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:06 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p" returned: 0 in 0.737s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:07 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p Sep 28 16:06:07 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:07 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p" returned: 1 in 0.492s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_ozxloq_p' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:06:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc5b8a1-0a1a-44d4-845a-fcd9170e1695]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:06:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:07 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD Sep 28 16:06:07 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:08 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:08 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] 4199de88-fb3b-44ba-ad33-1430d8c72a6b was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:06:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:08 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d Sep 28 16:06:08 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:13 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d" returned: 0 in 5.079s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:13 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_y0u27g6rdevstack@QuobyteHD, size 112.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:06:13 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Converted 112.00 MB image at 22.03 MB/s Sep 28 16:06:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:13 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1G Sep 28 16:06:13 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:14 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d 1G" returned: 0 in 0.969s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Downloaded image 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume 15bba0f3-0764-45a3-8c52-24ec8367a69d successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b for user 67989c7d734447d2a12364ae85d3f2c7 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Marking volume 15bba0f3-0764-45a3-8c52-24ec8367a69d as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Copying metadata from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b to 15bba0f3-0764-45a3-8c52-24ec8367a69d. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Creating volume glance metadata for volume 15bba0f3-0764-45a3-8c52-24ec8367a69d backed by image 4199de88-fb3b-44ba-ad33-1430d8c72a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d13156c8-6478-4a82-93b4-a25e0445af10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15bba0f3-0764-45a3-8c52-24ec8367a69d', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d8806c-adc8-471d-8f3b-664bd14af029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Volume volume-15bba0f3-0764-45a3-8c52-24ec8367a69d (15bba0f3-0764-45a3-8c52-24ec8367a69d): created successfully Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d8806c-adc8-471d-8f3b-664bd14af029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Flow 'volume_create_manager' (cbf84bfa-5689-4c4a-a4d0-1383c8484593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-41f9776d-edf7-4fdc-9e17-1cf700781728 tempest-ServerActionsTestOtherA-2122357938 None] Created volume successfully. Sep 28 16:06:24 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=13,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:24 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=7,cinder:SELECT=10,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-a4587720-91bc-4c7c-bd3c-f292d7e55f2e req-e073a708-26c2-4132-b46e-2f276f783dcb tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-a4587720-91bc-4c7c-bd3c-f292d7e55f2e req-e073a708-26c2-4132-b46e-2f276f783dcb tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-a4587720-91bc-4c7c-bd3c-f292d7e55f2e req-e073a708-26c2-4132-b46e-2f276f783dcb tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.068s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-a4587720-91bc-4c7c-bd3c-f292d7e55f2e req-e073a708-26c2-4132-b46e-2f276f783dcb tempest-ServerActionsTestOtherA-2122357938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-15bba0f3-0764-45a3-8c52-24ec8367a69d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ae3509-75c7-439a-b5d6-35ed097124c6', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-a4587720-91bc-4c7c-bd3c-f292d7e55f2e req-e073a708-26c2-4132-b46e-2f276f783dcb tempest-ServerActionsTestOtherA-2122357938 None] attachment_update completed successfully. Sep 28 16:06:35 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:35 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:36 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:06:36 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:36 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:06:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (f0fa20a2-e2f3-4c8f-b3b0-d9fac872f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1db3eb6-53c6-403a-8fd2-833bb0a80128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1db3eb6-53c6-403a-8fd2-833bb0a80128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299412227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b379599f-e39c-43a1-8c70-f7125561541b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:41Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020badab-9820-460b-995d-4af0fb2dafe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (020badab-9820-460b-995d-4af0fb2dafe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aae7d2a-472f-49c7-828b-d48d0a62cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aae7d2a-472f-49c7-828b-d48d0a62cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b379599f-e39c-43a1-8c70-f7125561541b', 'volume_name': 'volume-b379599f-e39c-43a1-8c70-f7125561541b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b7c0a3-cc21-49e2-9ff4-f9f79457ca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b7c0a3-cc21-49e2-9ff4-f9f79457ca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a4078-2086-4a0c-9fd9-55b8ce55e1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Volume b379599f-e39c-43a1-8c70-f7125561541b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b379599f-e39c-43a1-8c70-f7125561541b', 'volume_size': 1} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-299412227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b379599f-e39c-43a1-8c70-f7125561541b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:41Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Creating volume b379599f-e39c-43a1-8c70-f7125561541b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:41 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:06:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:41 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b 1073741824 Sep 28 16:06:41 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:43 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b 1073741824" returned: 0 in 1.669s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:43 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b Sep 28 16:06:43 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:43 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b" returned: 0 in 0.620s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.432s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f60a4078-2086-4a0c-9fd9-55b8ce55e1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b379599f-e39c-43a1-8c70-f7125561541b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21f6f90-bb48-4ddc-bdee-1b8941fbafe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Volume volume-b379599f-e39c-43a1-8c70-f7125561541b (b379599f-e39c-43a1-8c70-f7125561541b): created successfully Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21f6f90-bb48-4ddc-bdee-1b8941fbafe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (f0fa20a2-e2f3-4c8f-b3b0-d9fac872f51c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-abab9083-3682-4e5f-8692-8e5cc4473259 tempest-AttachVolumeNegativeTest-2143169128 None] Created volume successfully. Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Flow 'volume_create_manager' (2b2ac185-f9fd-41a8-aa0e-84db11261ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a044f4-15b4-40ec-8701-8dfbea5a5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a044f4-15b4-40ec-8701-8dfbea5a5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-916817441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e46cc6d-4241-4a92-b2e3-b10cdae6beef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a2e428ef5406490c1545a31926948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:44Z,use_quota=True,user_id='272e76109f42492090265527cbc451ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c853e7f-02f6-4026-a8e6-1e999be81faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c853e7f-02f6-4026-a8e6-1e999be81faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94269c0-5893-4aea-9b8c-766678713c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94269c0-5893-4aea-9b8c-766678713c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e46cc6d-4241-4a92-b2e3-b10cdae6beef', 'volume_name': 'volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe3c584-bd90-4c97-bc7a-be8e5a21a6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffe3c584-bd90-4c97-bc7a-be8e5a21a6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f7efce-a189-4e34-8e7e-51e38901db65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Volume 8e46cc6d-4241-4a92-b2e3-b10cdae6beef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef', 'volume_size': 1} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-916817441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e46cc6d-4241-4a92-b2e3-b10cdae6beef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='928a2e428ef5406490c1545a31926948',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:06:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:06:44Z,use_quota=True,user_id='272e76109f42492090265527cbc451ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Creating volume 8e46cc6d-4241-4a92-b2e3-b10cdae6beef {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:06:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:06:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:44 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef 1073741824 Sep 28 16:06:44 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:45 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef 1073741824" returned: 0 in 1.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:06:46 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef Sep 28 16:06:46 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:06:46 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" returned: 0 in 0.566s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f7efce-a189-4e34-8e7e-51e38901db65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0d774f-0d83-4ca4-9196-9b6685e8d758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:06:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Volume volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef (8e46cc6d-4241-4a92-b2e3-b10cdae6beef): created successfully Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0d774f-0d83-4ca4-9196-9b6685e8d758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:06:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Flow 'volume_create_manager' (2b2ac185-f9fd-41a8-aa0e-84db11261ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:06:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d073100f-a29c-418d-8519-7947f5d27412 tempest-AttachVolumeShelveTestJSON-608739136 None] Created volume successfully. Sep 28 16:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6781502f-4161-46d5-9bf6-95f39397beff req-6a15a90e-d1b8-468f-a575-4fdbc81bea00 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6781502f-4161-46d5-9bf6-95f39397beff req-6a15a90e-d1b8-468f-a575-4fdbc81bea00 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-6781502f-4161-46d5-9bf6-95f39397beff req-6a15a90e-d1b8-468f-a575-4fdbc81bea00 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6781502f-4161-46d5-9bf6-95f39397beff req-6a15a90e-d1b8-468f-a575-4fdbc81bea00 tempest-AttachVolumeNegativeTest-2143169128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-b379599f-e39c-43a1-8c70-f7125561541b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '691a4ea5-60be-4951-bf29-60c0af6183c6', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6781502f-4161-46d5-9bf6-95f39397beff req-6a15a90e-d1b8-468f-a575-4fdbc81bea00 tempest-AttachVolumeNegativeTest-2143169128 None] attachment_update completed successfully. Sep 28 16:06:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-6a5b29e4-08b3-48e3-a1a7-f2047945aab5 req-87adbab2-dc30-4b5c-bfac-a9770f3227bb tempest-AttachVolumeNegativeTest-2143169128 None] Terminate volume connection completed successfully. Sep 28 16:06:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-6a5b29e4-08b3-48e3-a1a7-f2047945aab5 req-87adbab2-dc30-4b5c-bfac-a9770f3227bb tempest-AttachVolumeNegativeTest-2143169128 None] Deleting attachment 691a4ea5-60be-4951-bf29-60c0af6183c6. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:06:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-6fcf2058-1ece-4bd5-adb9-b95d8b3a2353 tempest-ServerActionsTestOtherA-2122357938 None] Terminate volume connection completed successfully. Sep 28 16:06:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-6fcf2058-1ece-4bd5-adb9-b95d8b3a2353 tempest-ServerActionsTestOtherA-2122357938 None] Deleting attachment 32ae3509-75c7-439a-b5d6-35ed097124c6. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:06:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-ec62fa36-d0c4-41da-92b8-b8b5fccdc52e tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:06:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-ec62fa36-d0c4-41da-92b8-b8b5fccdc52e tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:06:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-ec62fa36-d0c4-41da-92b8-b8b5fccdc52e tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:06:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-ec62fa36-d0c4-41da-92b8-b8b5fccdc52e tempest-ServerActionsTestOtherA-2122357938 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-15bba0f3-0764-45a3-8c52-24ec8367a69d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb187415-d29b-4f6c-928b-96acd94431c5', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:06:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-206ba057-36ac-400a-acb2-7bd8fa991771 req-ec62fa36-d0c4-41da-92b8-b8b5fccdc52e tempest-ServerActionsTestOtherA-2122357938 None] attachment_update completed successfully. Sep 28 16:07:04 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:04 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=10,cinder:SELECT=16,cinder:INSERT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-cc878e7d-ff43-43c4-9a88-4f12f8c072f8 req-2e88200f-6da6-4fbb-849e-84d5dc9ea0c2 tempest-AttachVolumeShelveTestJSON-608739136 None] No connector for attachment 1f35e62a-4f31-46df-b8e3-9f41380a0fdb; skipping storage backend terminate_connection call. {{(pid=87150) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 28 16:07:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-cc878e7d-ff43-43c4-9a88-4f12f8c072f8 req-2e88200f-6da6-4fbb-849e-84d5dc9ea0c2 tempest-AttachVolumeShelveTestJSON-608739136 None] Deleting attachment 1f35e62a-4f31-46df-b8e3-9f41380a0fdb. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:07:16 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:16 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-526ca829-8c56-4039-9f60-05d844ee8997 req-60859497-9c93-4ddf-98d4-e8c19002dca5 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-526ca829-8c56-4039-9f60-05d844ee8997 req-60859497-9c93-4ddf-98d4-e8c19002dca5 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-526ca829-8c56-4039-9f60-05d844ee8997 req-60859497-9c93-4ddf-98d4-e8c19002dca5 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-526ca829-8c56-4039-9f60-05d844ee8997 req-60859497-9c93-4ddf-98d4-e8c19002dca5 tempest-TaggedAttachmentsTest-1791171013 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '07e0c802-ff31-4b6e-a105-84e5ab87efb0', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:07:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-526ca829-8c56-4039-9f60-05d844ee8997 req-60859497-9c93-4ddf-98d4-e8c19002dca5 tempest-TaggedAttachmentsTest-1791171013 None] attachment_update completed successfully. Sep 28 16:07:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-50ce9e29-320c-4961-a5c3-2fc1e512d476 req-3ba2ea68-dd1d-48ae-a9e3-e09914bbf405 tempest-TaggedAttachmentsTest-1791171013 None] Terminate volume connection completed successfully. Sep 28 16:07:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-50ce9e29-320c-4961-a5c3-2fc1e512d476 req-3ba2ea68-dd1d-48ae-a9e3-e09914bbf405 tempest-TaggedAttachmentsTest-1791171013 None] Deleting attachment 07e0c802-ff31-4b6e-a105-84e5ab87efb0. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:36 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:07:36 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:36 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.527s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:07:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:07:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "cinder-be98ca42-6d74-4cf8-bd5a-27b99b086e8e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "cinder-be98ca42-6d74-4cf8-bd5a-27b99b086e8e-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "cinder-quobyte-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "cinder-quobyte-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c050b-0c79-4dc6-bb9e-9dfe6a7f3dcb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:48 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e Sep 28 16:07:48 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-2811b05e-28dd-4124-b5cd-ca68a99300a0 tempest-ServerActionsTestOtherA-2122357938 None] Terminate volume connection completed successfully. Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-2811b05e-28dd-4124-b5cd-ca68a99300a0 tempest-ServerActionsTestOtherA-2122357938 None] Deleting attachment eb187415-d29b-4f6c-928b-96acd94431c5. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:07:49 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" returned: 0 in 0.680s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e Sep 28 16:07:49 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "cinder-15bba0f3-0764-45a3-8c52-24ec8367a69d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-15bba0f3-0764-45a3-8c52-24ec8367a69d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "cinder-quobyte-15bba0f3-0764-45a3-8c52-24ec8367a69d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-quobyte-15bba0f3-0764-45a3-8c52-24ec8367a69d" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[156c1c24-a364-4fea-b66a-72f5be76ddaf]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" returned: 0 in 0.362s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "cinder-quobyte-be98ca42-6d74-4cf8-bd5a-27b99b086e8e" released by "delete_volume" :: held 1.163s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Created reservations ['0ae2e576-d29d-493b-a945-8aaeb911c0c7', 'd5b4046e-e38b-4fb5-8ec8-09618c62c2cb', '75af1519-3b5b-4b79-af75-2bcc3b8c1d76', '668d671a-3370-41e3-a08b-9f95170a57ed'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:49 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d Sep 28 16:07:49 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:49 devstack sudo[92368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:07:49 devstack sudo[92368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:50 devstack sudo[92368]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Deleted volume successfully. Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4598072-ea8f-440e-9822-aeff70ef4ac9 tempest-TaggedAttachmentsTest-1791171013 None] Lock "cinder-be98ca42-6d74-4cf8-bd5a-27b99b086e8e-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:50 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d" returned: 0 in 0.658s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:50 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d Sep 28 16:07:50 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "cinder-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:50 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-15bba0f3-0764-45a3-8c52-24ec8367a69d" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-quobyte-15bba0f3-0764-45a3-8c52-24ec8367a69d" released by "delete_volume" :: held 1.180s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "cinder-quobyte-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-quobyte-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG cinder.quota [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Created reservations ['770b40db-041f-42df-8ba1-5fef65e82001', '5bfc716c-bb19-4a80-abfa-a6f85fc0ed85', 'a522b746-b8ee-4425-bb32-1c09a2772a9a', 'a3a3e277-9db6-4974-96da-ac62b3011abf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d206737-25e6-4d79-a35b-16095fad09e3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:07:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:51 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d Sep 28 16:07:51 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:51 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:07:51 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:51 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG cinder.manager [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Deleted volume successfully. Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-153eb4e4-a2c2-4cc2-9426-c6806e7f4165 req-b23db6f3-1991-4123-8869-7d9bc4bce8cd tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-15bba0f3-0764-45a3-8c52-24ec8367a69d-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:51 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" returned: 0 in 0.618s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:51 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d Sep 28 16:07:51 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:51 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-quobyte-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d" released by "delete_volume" :: held 1.077s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Created reservations ['6ec9c060-e65e-4eb0-b823-b34669f4196c', '5fcb69c9-8745-4935-9202-4fd1870c5704', '1b4b0774-7469-4ad7-a859-3333ee6e4bb8', '8934ab9f-d582-4e91-9b44-f7eded4df1fe'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:07:52 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:07:52 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:07:52 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.394s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:07:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Deleted volume successfully. Sep 28 16:07:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-651d51fe-8de6-4c80-818f-b0b99ce3ad7a tempest-ServerActionsTestOtherA-2122357938 None] Lock "cinder-f9e6f084-f5c9-4a36-8fea-a3c0c2f5895d-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:02 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=17,cinder:UPDATE=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:02 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=30,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (2ac0e0a2-2b55-4e5e-ad15-27b5a2ba9284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7126592c-6962-4630-8659-11526d8dfef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7126592c-6962-4630-8659-11526d8dfef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-935568592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c57dda-7824-4a9a-8587-7e0f5cc0a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:09Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b953d4-1349-42d6-a16b-3988528d2228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b953d4-1349-42d6-a16b-3988528d2228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8d34c1-21a7-4e82-95ec-464012700e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8d34c1-21a7-4e82-95ec-464012700e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c57dda-7824-4a9a-8587-7e0f5cc0a85a', 'volume_name': 'volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a54bd4-98b7-4a8f-8ef7-ead4357e4c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a54bd4-98b7-4a8f-8ef7-ead4357e4c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6d31a-e35e-4ebb-9d7e-6556b1f268df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Volume 56c57dda-7824-4a9a-8587-7e0f5cc0a85a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a', 'volume_size': 1} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-935568592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c57dda-7824-4a9a-8587-7e0f5cc0a85a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e462f8e3efec48c6ae310be13f803f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:09Z,use_quota=True,user_id='3f0eba36042f4271b1013f6567ebbfee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Creating volume 56c57dda-7824-4a9a-8587-7e0f5cc0a85a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:08:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:09 devstack sudo[92481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a 1073741824 Sep 28 16:08:09 devstack sudo[92481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:10 devstack sudo[92481]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a 1073741824" returned: 0 in 0.773s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:10 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a Sep 28 16:08:10 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Flow 'volume_create_manager' (0d634e7e-5ff8-49bd-8413-0d17643da8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca15916-6e6f-4f01-a451-90b299940713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ca15916-6e6f-4f01-a451-90b299940713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1849094663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201ec296-7ca5-4bf7-b7ba-b41b5074b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5994cbcb1bdd43bfa7c5c78e41bdcc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:10Z,use_quota=True,user_id='e65fbb770c32477bb81e9f4b409d5d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256781c9-0675-4a8d-b96e-cd97110d1c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256781c9-0675-4a8d-b96e-cd97110d1c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aeea71-887f-4e60-9e64-e229a09816ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9aeea71-887f-4e60-9e64-e229a09816ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '201ec296-7ca5-4bf7-b7ba-b41b5074b5aa', 'volume_name': 'volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b165f-7aa5-4cd2-96c2-36f6221c97d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268b165f-7aa5-4cd2-96c2-36f6221c97d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8800ea3-d60f-47ef-a82f-bc197cfadbd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Volume 201ec296-7ca5-4bf7-b7ba-b41b5074b5aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa', 'volume_size': 1} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:10 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1849094663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=201ec296-7ca5-4bf7-b7ba-b41b5074b5aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5994cbcb1bdd43bfa7c5c78e41bdcc80',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:10Z,use_quota=True,user_id='e65fbb770c32477bb81e9f4b409d5d79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Creating volume 201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfb6d31a-e35e-4ebb-9d7e-6556b1f268df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33f12eb-26ba-448f-854f-2c3fe60c28e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:10 devstack sudo[92490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa 1073741824 Sep 28 16:08:10 devstack sudo[92490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Volume volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a (56c57dda-7824-4a9a-8587-7e0f5cc0a85a): created successfully Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a33f12eb-26ba-448f-854f-2c3fe60c28e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Flow 'volume_create_manager' (2ac0e0a2-2b55-4e5e-ad15-27b5a2ba9284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-305cae8f-51c5-427d-bcf7-d69efb52a950 tempest-AttachVolumeNegativeTest-2143169128 None] Created volume successfully. Sep 28 16:08:11 devstack sudo[92490]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa 1073741824" returned: 0 in 0.621s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:11 devstack sudo[92498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa Sep 28 16:08:11 devstack sudo[92498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:11 devstack sudo[92498]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8800ea3-d60f-47ef-a82f-bc197cfadbd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb232cec-09c5-4b09-9540-639e5ce09648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Volume volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa (201ec296-7ca5-4bf7-b7ba-b41b5074b5aa): created successfully Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb232cec-09c5-4b09-9540-639e5ce09648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Flow 'volume_create_manager' (0d634e7e-5ff8-49bd-8413-0d17643da8f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-68610c1b-8be2-4c34-8a2a-e4d01461889a req-05cd648a-54f6-4ed0-8c14-838f2f036239 tempest-VolumesSnapshotsTestJSON-1485060884 None] Created volume successfully. Sep 28 16:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2baba974-0c56-4801-af3e-b7832e15579a req-2362b603-fe9d-4bc2-ad6e-3a5fec0f41f6 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2baba974-0c56-4801-af3e-b7832e15579a req-2362b603-fe9d-4bc2-ad6e-3a5fec0f41f6 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-2baba974-0c56-4801-af3e-b7832e15579a req-2362b603-fe9d-4bc2-ad6e-3a5fec0f41f6 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.063s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-2baba974-0c56-4801-af3e-b7832e15579a req-2362b603-fe9d-4bc2-ad6e-3a5fec0f41f6 tempest-AttachVolumeNegativeTest-2143169128 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d9bd1ed-65ff-4d2b-80a0-ae5c34798601', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:08:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-2baba974-0c56-4801-af3e-b7832e15579a req-2362b603-fe9d-4bc2-ad6e-3a5fec0f41f6 tempest-AttachVolumeNegativeTest-2143169128 None] attachment_update completed successfully. Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Creating offline snapshot 7e049e2b-bc42-41b8-b5d2-4300533b543b of volume 201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7e9ab8-fc55-4e0f-a94a-c768e97d5a4e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:13 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa Sep 28 16:08:13 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:14 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" returned: 0 in 0.833s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:14 devstack sudo[92961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b 1G Sep 28 16:08:14 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:15 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b 1G" returned: 0 in 0.873s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:15 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b Sep 28 16:08:15 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:16 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b" returned: 0 in 0.619s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b is being set with open permissions: ugo+rw Sep 28 16:08:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:16 devstack sudo[92979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b Sep 28 16:08:16 devstack sudo[92979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:16 devstack sudo[92979]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b" returned: 0 in 0.781s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:16 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info Sep 28 16:08:16 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:17 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info" returned: 0 in 0.591s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:17 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info is being set with open permissions: ugo+rw Sep 28 16:08:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:17 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info Sep 28 16:08:17 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:17 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.info" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-ea98e544-e669-4a7f-9d7d-406aebccd56f req-3759f3c5-1784-4ae1-b82c-99ed1632b1f5 tempest-VolumesSnapshotsTestJSON-1485060884 None] Create snapshot completed successfully Sep 28 16:08:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-efb579c3-5a1a-44ba-85ab-90c90e27545d req-6630abbd-9892-40fa-ba47-ca2688f476b5 tempest-AttachVolumeNegativeTest-2143169128 None] Terminate volume connection completed successfully. Sep 28 16:08:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-efb579c3-5a1a-44ba-85ab-90c90e27545d req-6630abbd-9892-40fa-ba47-ca2688f476b5 tempest-AttachVolumeNegativeTest-2143169128 None] Deleting attachment 2d9bd1ed-65ff-4d2b-80a0-ae5c34798601. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "cinder-7e049e2b-bc42-41b8-b5d2-4300533b543b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-7e049e2b-bc42-41b8-b5d2-4300533b543b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "cinder-quobyte-7e049e2b-bc42-41b8-b5d2-4300533b543b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-7e049e2b-bc42-41b8-b5d2-4300533b543b" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Deleting offline snapshot 7e049e2b-bc42-41b8-b5d2-4300533b543b of volume 201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] snapshot_file for this snap is: volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295e824-0f69-48ec-bfdf-c0e515104fe5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:19 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b Sep 28 16:08:19 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:20 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b" returned: 0 in 0.854s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b16e7c-2962-403a-aed2-62f0a6a7fac6]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:20 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa Sep 28 16:08:20 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:20 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" returned: 0 in 0.678s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:20 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b Sep 28 16:08:20 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Acquiring lock "cinder-8e46cc6d-4241-4a92-b2e3-b10cdae6beef-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "cinder-8e46cc6d-4241-4a92-b2e3-b10cdae6beef-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Acquiring lock "cinder-quobyte-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "cinder-quobyte-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:21 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f5a1ce-4563-4311-a892-a4e466c8fa36]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b" returned: 0 in 0.788s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:21 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b Sep 28 16:08:21 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:21 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef Sep 28 16:08:21 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:22 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa.7e049e2b-bc42-41b8-b5d2-4300533b543b" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-7e049e2b-bc42-41b8-b5d2-4300533b543b" released by "_delete_snapshot" :: held 2.903s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" released by "delete_snapshot" :: held 2.949s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:22 devstack cinder-volume[87150]: WARNING cinder.quota [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.quota [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Created reservations ['68e91544-fa68-4534-baea-e29ec8cefca1', '515eba3b-ef34-4158-bbff-292d3fcb09a0', '2c989f7e-62a1-4456-8e19-8b3c0955c47b', '8085652b-0115-4b60-bd4f-370456c98405'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:22 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" returned: 0 in 0.619s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:22 devstack sudo[93068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef Sep 28 16:08:22 devstack sudo[93068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Delete snapshot completed successfully. Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-8d7f2bb5-254b-4cdd-ac9f-b88fc5bea0a5 req-978881e4-b583-48fa-8007-640ecc425e66 tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-7e049e2b-bc42-41b8-b5d2-4300533b543b-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:22 devstack sudo[93068]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" returned: 0 in 0.560s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "cinder-quobyte-8e46cc6d-4241-4a92-b2e3-b10cdae6beef" released by "delete_volume" :: held 1.300s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "cinder-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Created reservations ['bc03b776-d82f-404e-877c-c8debe999615', '65f92e25-c6ac-4f57-99c9-db7908433d6f', 'bba0112f-e78a-412f-9809-3b76e3bdbf31', '1748323a-a4fd-4e20-91ec-8dcc88e78660'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ba26f4-4482-40cc-ba5d-494610cdc671]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:23 devstack sudo[93073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:23 devstack sudo[93073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:23 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa Sep 28 16:08:23 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:23 devstack sudo[93073]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Deleted volume successfully. Sep 28 16:08:23 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" returned: 0 in 0.644s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:23 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa Sep 28 16:08:23 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:24 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dc812f0-cf19-4ad2-9a28-d64d61eda57c tempest-AttachVolumeShelveTestJSON-608739136 None] Lock "cinder-8e46cc6d-4241-4a92-b2e3-b10cdae6beef-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-quobyte-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa" released by "delete_volume" :: held 1.175s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG cinder.quota [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Created reservations ['b2df8628-0bff-47e8-b009-9625e2bc63f6', '86688d81-d2f8-405a-befa-92c909bd2989', '6d7e99aa-390e-4373-82be-1852b0c4334b', '09122e3a-7682-4ac6-8738-13f8dd99aa81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:24 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:24 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:25 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.468s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:25 devstack cinder-volume[87150]: DEBUG cinder.manager [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Deleted volume successfully. Sep 28 16:08:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-5f42c53f-3a09-4a3f-bae6-44bd5a0d8b0f req-92c624de-272a-4940-8002-302f0de129ad tempest-VolumesSnapshotsTestJSON-1485060884 None] Lock "cinder-201ec296-7ca5-4bf7-b7ba-b41b5074b5aa-delete_volume" released by "delete_volume" :: held 2.083s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-56c57dda-7824-4a9a-8587-7e0f5cc0a85a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-56c57dda-7824-4a9a-8587-7e0f5cc0a85a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-quobyte-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5bcd7-da08-4f76-a684-2bad0181814c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:30 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a Sep 28 16:08:30 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:30 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" returned: 0 in 0.578s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:30 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a Sep 28 16:08:30 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:31 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-56c57dda-7824-4a9a-8587-7e0f5cc0a85a" released by "delete_volume" :: held 1.084s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Created reservations ['1ea22c6e-f8d6-4649-be69-683b519694d2', '1d5a0c04-63e6-48e7-abc0-592142343b1e', '38878552-0575-4150-aa5d-8ebd929628d3', '1a35fb7e-ba61-4851-b73e-5337be88fce8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:31 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:31 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:31 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.478s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Deleted volume successfully. Sep 28 16:08:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1b9d19a-25cc-408a-ad12-7ef36e53b02a tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-56c57dda-7824-4a9a-8587-7e0f5cc0a85a-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Flow 'volume_create_manager' (92fe7532-b824-432d-8823-492ad135c466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deadaa76-2f60-4935-9f67-e78d4fb7af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deadaa76-2f60-4935-9f67-e78d4fb7af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-428080224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc24b1-3dcb-46d9-8986-9bda01d04904,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bd569ef8f85434abd3814426c3fd186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:33Z,use_quota=True,user_id='471bb9875d534f6eae9df9d00c87213e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa373f93-af29-426a-b17f-11ff16bbece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa373f93-af29-426a-b17f-11ff16bbece4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54906e1e-9246-42d3-8238-42e99c4da953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54906e1e-9246-42d3-8238-42e99c4da953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93cc24b1-3dcb-46d9-8986-9bda01d04904', 'volume_name': 'volume-93cc24b1-3dcb-46d9-8986-9bda01d04904', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175b684c-9f37-49c1-a03d-42928ef958ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (175b684c-9f37-49c1-a03d-42928ef958ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3e1251-550c-45af-b122-13e10d4692cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Volume 93cc24b1-3dcb-46d9-8986-9bda01d04904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93cc24b1-3dcb-46d9-8986-9bda01d04904', 'volume_size': 1} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-428080224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93cc24b1-3dcb-46d9-8986-9bda01d04904,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5bd569ef8f85434abd3814426c3fd186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:08:33Z,use_quota=True,user_id='471bb9875d534f6eae9df9d00c87213e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Creating volume 93cc24b1-3dcb-46d9-8986-9bda01d04904 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:08:33 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:33 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 1073741824 Sep 28 16:08:33 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-b379599f-e39c-43a1-8c70-f7125561541b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-b379599f-e39c-43a1-8c70-f7125561541b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-quobyte-b379599f-e39c-43a1-8c70-f7125561541b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-b379599f-e39c-43a1-8c70-f7125561541b" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b7f8d6-3afd-4466-8513-cefa245f7c28]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:33 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b Sep 28 16:08:33 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:34 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b" returned: 0 in 0.713s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:34 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b Sep 28 16:08:34 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:34 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 1073741824" returned: 0 in 1.032s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:34 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 Sep 28 16:08:34 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:34 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b379599f-e39c-43a1-8c70-f7125561541b" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-b379599f-e39c-43a1-8c70-f7125561541b" released by "delete_volume" :: held 1.360s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Created reservations ['a2d1c75e-9658-422d-b3c1-c37b2b4964a2', '49267769-935f-4fad-9aee-265ae56d1d77', 'c553b7fd-485f-4b6d-bb24-a38ac27891da', '866eab74-f263-4d5a-a6aa-7e2956252fa0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:34 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904" returned: 0 in 0.646s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3e1251-550c-45af-b122-13e10d4692cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93cc24b1-3dcb-46d9-8986-9bda01d04904', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8daa677-6834-4d3c-99c9-9f00cb027a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:08:35 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Volume volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 (93cc24b1-3dcb-46d9-8986-9bda01d04904): created successfully Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8daa677-6834-4d3c-99c9-9f00cb027a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Flow 'volume_create_manager' (92fe7532-b824-432d-8823-492ad135c466) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-53364fc1-5362-417f-a6db-425756e6e438 req-ddc18898-9466-41a4-9114-a427c07a7b15 tempest-VolumesGetTestJSON-726942956 None] Created volume successfully. Sep 28 16:08:35 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:35 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:35 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Deleted volume successfully. Sep 28 16:08:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-30b1d4c0-9811-4b23-8028-2edb1b4b1f35 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-b379599f-e39c-43a1-8c70-f7125561541b-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Acquiring lock "cinder-93cc24b1-3dcb-46d9-8986-9bda01d04904-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "cinder-93cc24b1-3dcb-46d9-8986-9bda01d04904-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Acquiring lock "cinder-quobyte-93cc24b1-3dcb-46d9-8986-9bda01d04904" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-9b656424-def6-480c-a719-7af826d9a48b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "cinder-quobyte-93cc24b1-3dcb-46d9-8986-9bda01d04904" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-9b656424-def6-480c-a719-7af826d9a48b-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcebd232-3607-4637-b781-01dca7430c53]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "cinder-quobyte-9b656424-def6-480c-a719-7af826d9a48b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-9b656424-def6-480c-a719-7af826d9a48b" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2187956b-a204-4c73-8c94-2dddc75f3d69]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:08:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:36 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:36 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:36 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 Sep 28 16:08:36 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:36 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b Sep 28 16:08:36 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:37 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.751s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:08:37 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904" returned: 0 in 0.949s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:37 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904 Sep 28 16:08:37 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:37 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b" returned: 0 in 1.063s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:37 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b Sep 28 16:08:37 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:37 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93cc24b1-3dcb-46d9-8986-9bda01d04904" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "cinder-quobyte-93cc24b1-3dcb-46d9-8986-9bda01d04904" released by "delete_volume" :: held 1.566s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.quota [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Created reservations ['baeeca21-e697-43eb-8f8f-b77f69ad893e', '1a4d2016-71b1-495b-9b23-defe7ff0913c', 'a1e86a78-1e46-4c7e-9662-1575f3093599', '6c10f41b-f261-4712-9b0e-f9514c03a3b1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:38 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b656424-def6-480c-a719-7af826d9a48b" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-quobyte-9b656424-def6-480c-a719-7af826d9a48b" released by "delete_volume" :: held 1.747s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:38 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:38 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Created reservations ['9a51c177-5db6-44ea-9452-232af0c2c2c7', 'bb102723-5dfe-4c91-b425-840e18b94a1b', 'cbdbb598-915e-4f3b-b92b-24470401bc00', '1c28e4f2-0bc0-4391-8c02-aae173a28031'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:08:38 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:08:38 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:08:38 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.607s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.manager [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Deleted volume successfully. Sep 28 16:08:38 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.422s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:08:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Deleted volume successfully. Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-126d6d7e-aed1-4e28-bb7d-fc09fc5b51bc req-9b6c881a-8eea-451b-a70e-eaed7fc2ff93 tempest-VolumesGetTestJSON-726942956 None] Lock "cinder-93cc24b1-3dcb-46d9-8986-9bda01d04904-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4b2efd35-a472-4e9e-b38d-5d115cc62d12 tempest-AttachVolumeNegativeTest-2143169128 None] Lock "cinder-9b656424-def6-480c-a719-7af826d9a48b-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:08:48 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=65,cinder:SELECT=55,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:08:48 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=50,cinder:UPDATE=66,cinder:INSERT=19,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (9085b188-2257-4fa6-ac14-19dcc6685773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e673eca-630a-4e10-8954-5b2983aee7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e673eca-630a-4e10-8954-5b2983aee7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983772627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d364b-798c-4ad1-b434-3d8c39ce9428,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:00Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c68595-68f7-4c51-a8f6-23ba57a634d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84c68595-68f7-4c51-a8f6-23ba57a634d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f7d82-932a-499c-9296-b93316e5e743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1f7d82-932a-499c-9296-b93316e5e743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d9d364b-798c-4ad1-b434-3d8c39ce9428', 'volume_name': 'volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc8662c-8ac2-4098-ada3-741100425eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bc8662c-8ac2-4098-ada3-741100425eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074253fc-c7f8-4189-9743-fd9a5dd951b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Volume 0d9d364b-798c-4ad1-b434-3d8c39ce9428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428', 'volume_size': 1} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-983772627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d9d364b-798c-4ad1-b434-3d8c39ce9428,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:00Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Creating volume 0d9d364b-798c-4ad1-b434-3d8c39ce9428 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:09:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:00 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 1073741824 Sep 28 16:09:00 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:01 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 1073741824" returned: 0 in 1.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:02 devstack sudo[93382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 Sep 28 16:09:02 devstack sudo[93382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:02 devstack sudo[93382]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428" returned: 0 in 0.799s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.340s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074253fc-c7f8-4189-9743-fd9a5dd951b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c47688-a355-439e-b877-9c8b73f04fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Volume volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 (0d9d364b-798c-4ad1-b434-3d8c39ce9428): created successfully Sep 28 16:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73c47688-a355-439e-b877-9c8b73f04fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (9085b188-2257-4fa6-ac14-19dcc6685773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-612b09cd-15af-466a-9c85-1689261e9391 tempest-VolumesTestJSON-2034926101 None] Created volume successfully. Sep 28 16:09:05 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (84163dee-6ea8-4492-b582-a2603e060a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82c18be-c2b4-47d4-97a2-c7299e898100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a82c18be-c2b4-47d4-97a2-c7299e898100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664180264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197834c-680b-45db-b26b-fc57868fabba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:06Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b939b215-46e8-452e-b5e6-881bf6a98aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b939b215-46e8-452e-b5e6-881bf6a98aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965a62-aa22-468a-9e40-73e5e9ddcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd965a62-aa22-468a-9e40-73e5e9ddcaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5197834c-680b-45db-b26b-fc57868fabba', 'volume_name': 'volume-5197834c-680b-45db-b26b-fc57868fabba', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b67180-2680-4ed0-a2e1-2d3a2e9c15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b67180-2680-4ed0-a2e1-2d3a2e9c15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6fc3e6-e248-421b-a6e7-6207d2a89535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Volume 5197834c-680b-45db-b26b-fc57868fabba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5197834c-680b-45db-b26b-fc57868fabba', 'volume_size': 1} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1664180264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5197834c-680b-45db-b26b-fc57868fabba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:06Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Creating volume 5197834c-680b-45db-b26b-fc57868fabba {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:09:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:06 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba 1073741824 Sep 28 16:09:06 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba 1073741824" returned: 0 in 0.933s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:07 devstack sudo[93410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba Sep 28 16:09:07 devstack sudo[93410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:07 devstack sudo[93410]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba" returned: 0 in 0.744s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc6fc3e6-e248-421b-a6e7-6207d2a89535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5197834c-680b-45db-b26b-fc57868fabba', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acef19b4-b0a2-4853-bbe0-be8479fdcbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Volume volume-5197834c-680b-45db-b26b-fc57868fabba (5197834c-680b-45db-b26b-fc57868fabba): created successfully Sep 28 16:09:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acef19b4-b0a2-4853-bbe0-be8479fdcbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (84163dee-6ea8-4492-b582-a2603e060a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-83cc217a-7e8c-46bc-a243-cf3cae8e6b92 tempest-VolumesTestJSON-2034926101 None] Created volume successfully. Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Flow 'volume_create_manager' (334d96d0-27ef-41c6-b107-d3ef00f4ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1f67d6-73da-422e-a041-1c9c71a08ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d1f67d6-73da-422e-a041-1c9c71a08ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536496843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd54d90c-2281-4adf-bf48-28296490d6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd92c9b0b9c445a9842d89699c2f3a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:10Z,use_quota=True,user_id='165beda5baa14423a2fd7ba8b45cfc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400b0af9-b732-437c-981f-32017816c14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (400b0af9-b732-437c-981f-32017816c14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b19b52-b300-4d5d-aaca-acb2dc043af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b19b52-b300-4d5d-aaca-acb2dc043af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd54d90c-2281-4adf-bf48-28296490d6d8', 'volume_name': 'volume-bd54d90c-2281-4adf-bf48-28296490d6d8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc85033-8a25-46ee-9e25-15254284e39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc85033-8a25-46ee-9e25-15254284e39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc9c147-da57-455c-bb6a-2344b5fbcc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Volume bd54d90c-2281-4adf-bf48-28296490d6d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd54d90c-2281-4adf-bf48-28296490d6d8', 'volume_size': 1} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536496843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd54d90c-2281-4adf-bf48-28296490d6d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd92c9b0b9c445a9842d89699c2f3a98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:10Z,use_quota=True,user_id='165beda5baa14423a2fd7ba8b45cfc49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Creating volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:10 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 1073741824 Sep 28 16:09:10 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (a7d4f62e-7f22-4fca-92a1-3c1946f75776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaaca71-e002-4970-a12a-8188f02977be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aaaca71-e002-4970-a12a-8188f02977be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-93007427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aa74f5-f197-4794-b3f8-653d8f013bc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad48951-6a33-4888-b711-f311677a3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad48951-6a33-4888-b711-f311677a3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf850411-cb8c-460d-81cb-7ee9224e323f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf850411-cb8c-460d-81cb-7ee9224e323f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05aa74f5-f197-4794-b3f8-653d8f013bc4', 'volume_name': 'volume-05aa74f5-f197-4794-b3f8-653d8f013bc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e50afe-da71-4c30-8180-7aa5bf2b3758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7e50afe-da71-4c30-8180-7aa5bf2b3758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159e55e6-e933-4af1-a973-b678f95891a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Volume 05aa74f5-f197-4794-b3f8-653d8f013bc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05aa74f5-f197-4794-b3f8-653d8f013bc4', 'volume_size': 1} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:11 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 1073741824" returned: 0 in 1.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:11 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 Sep 28 16:09:11 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:12 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8" returned: 0 in 0.468s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] <== create_volume: return (1941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-93007427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aa74f5-f197-4794-b3f8-653d8f013bc4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76338faf1fde4b6f946b0fed24f0932b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:11Z,use_quota=True,user_id='9ee214d448aa4b4ea5aae1cacdf6202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Creating volume 05aa74f5-f197-4794-b3f8-653d8f013bc4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:12 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:12 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 1073741824 Sep 28 16:09:12 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bc9c147-da57-455c-bb6a-2344b5fbcc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd54d90c-2281-4adf-bf48-28296490d6d8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b863c8df-642f-4bae-862f-b7d986b9fb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Volume volume-bd54d90c-2281-4adf-bf48-28296490d6d8 (bd54d90c-2281-4adf-bf48-28296490d6d8): created successfully Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b863c8df-642f-4bae-862f-b7d986b9fb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Flow 'volume_create_manager' (334d96d0-27ef-41c6-b107-d3ef00f4ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0fa1f1af-ac08-4ea6-af65-47e8bb927da3 tempest-SnapshotsActionsTest-1761365102 None] Created volume successfully. Sep 28 16:09:13 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 1073741824" returned: 0 in 1.016s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:13 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 Sep 28 16:09:13 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Flow 'volume_create_manager' (7853c8ee-011f-4996-b409-6fcbb3e3bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c4b58-8de4-4193-aaba-5765bfab29a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (435c4b58-8de4-4193-aaba-5765bfab29a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1465869800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681e0f69-da42-4219-84ea-23df42ac44f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ac870dae7496eab7dfd225f586877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:14Z,use_quota=True,user_id='0603101030bc4a958f62a159a1e59011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd08414-f8ec-44ee-a160-02366469329b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd08414-f8ec-44ee-a160-02366469329b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318ad9e-f8b1-471c-ade4-a47162f567cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a318ad9e-f8b1-471c-ade4-a47162f567cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '681e0f69-da42-4219-84ea-23df42ac44f3', 'volume_name': 'volume-681e0f69-da42-4219-84ea-23df42ac44f3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f194f0-fb3f-4571-b1be-229a22d361f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f194f0-fb3f-4571-b1be-229a22d361f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e81af0-30b4-46f1-be8d-6194173d1cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Volume 681e0f69-da42-4219-84ea-23df42ac44f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-681e0f69-da42-4219-84ea-23df42ac44f3', 'volume_size': 1} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:14 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4" returned: 0 in 0.773s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] <== create_volume: return (1909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.917s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1465869800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=681e0f69-da42-4219-84ea-23df42ac44f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='765ac870dae7496eab7dfd225f586877',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:09:14Z,use_quota=True,user_id='0603101030bc4a958f62a159a1e59011',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Creating volume 681e0f69-da42-4219-84ea-23df42ac44f3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:09:14 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:14 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 1073741824 Sep 28 16:09:14 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159e55e6-e933-4af1-a973-b678f95891a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05aa74f5-f197-4794-b3f8-653d8f013bc4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d83feec-e64d-4c81-a88f-7444afda942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Volume volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 (05aa74f5-f197-4794-b3f8-653d8f013bc4): created successfully Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d83feec-e64d-4c81-a88f-7444afda942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Flow 'volume_create_manager' (a7d4f62e-7f22-4fca-92a1-3c1946f75776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d53c24df-3986-4798-b219-d11e0d03b9b5 tempest-VolumesTestJSON-2034926101 None] Created volume successfully. Sep 28 16:09:15 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 1073741824" returned: 0 in 0.852s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:15 devstack sudo[93500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 Sep 28 16:09:15 devstack sudo[93500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:15 devstack sudo[93500]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] <== create_volume: return (1343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.232s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e81af0-30b4-46f1-be8d-6194173d1cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-681e0f69-da42-4219-84ea-23df42ac44f3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d65c2-92c7-4267-ad31-677560579f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Creating offline snapshot cdcde6b4-fa42-4774-82c1-de68d66e9172 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Volume volume-681e0f69-da42-4219-84ea-23df42ac44f3 (681e0f69-da42-4219-84ea-23df42ac44f3): created successfully Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1d65c2-92c7-4267-ad31-677560579f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Flow 'volume_create_manager' (7853c8ee-011f-4996-b409-6fcbb3e3bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4543a37a-d95a-41fb-b0a5-29db3accb11a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1aab71c8-d65a-4a9a-a6aa-66a8f7993f99 tempest-ServerRescueNegativeTestJSON-2145613559 None] Created volume successfully. Sep 28 16:09:15 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 Sep 28 16:09:15 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:16 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8" returned: 0 in 0.565s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:16 devstack sudo[93509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 1G Sep 28 16:09:16 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:17 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 1G" returned: 0 in 0.998s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:17 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:17 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:17 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.609s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:17 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 is being set with open permissions: ugo+rw Sep 28 16:09:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:18 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:18 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-05aa74f5-f197-4794-b3f8-653d8f013bc4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-05aa74f5-f197-4794-b3f8-653d8f013bc4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-quobyte-05aa74f5-f197-4794-b3f8-653d8f013bc4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-05aa74f5-f197-4794-b3f8-653d8f013bc4" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b65bf0c-5a20-482e-959a-13fb9515c915]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:18 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.582s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:18 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 Sep 28 16:09:18 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:18 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info Sep 28 16:09:18 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:19 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info" returned: 0 in 0.597s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info is being set with open permissions: ugo+rw Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:19 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info Sep 28 16:09:19 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:19 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4" returned: 0 in 1.001s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:19 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4 Sep 28 16:09:19 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:19 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.info" returned: 0 in 0.604s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.203s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:19 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9c430f7b-d2ae-41c7-bba0-ff4967710f11 tempest-SnapshotsActionsTest-1761365102 None] Create snapshot completed successfully Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-05aa74f5-f197-4794-b3f8-653d8f013bc4" returned: 0 in 0.585s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-05aa74f5-f197-4794-b3f8-653d8f013bc4" released by "delete_volume" :: held 1.694s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Created reservations ['dac0e123-bc9b-4f7b-8088-d6c5d1f2965d', '99ed6ddf-1614-47ea-95bf-0efbcaf1af7f', 'c484a60d-b462-469a-b5e8-0505807f6c5e', 'ed57879a-5d38-4111-bbcf-7e7f0c257343'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:20 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:09:20 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-5197834c-680b-45db-b26b-fc57868fabba-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-5197834c-680b-45db-b26b-fc57868fabba-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:20 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Deleted volume successfully. Sep 28 16:09:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-dab476b0-5de8-4f3d-9549-ecc230a23417 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-05aa74f5-f197-4794-b3f8-653d8f013bc4-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-quobyte-5197834c-680b-45db-b26b-fc57868fabba" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-5197834c-680b-45db-b26b-fc57868fabba" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7d5429-a01b-492a-9be8-ac232246f1c9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:21 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba Sep 28 16:09:21 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:22 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba" returned: 0 in 1.181s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:22 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba Sep 28 16:09:22 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Creating offline snapshot 5b371254-3d6e-4295-aa57-d4a7d2c9dc73 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cbd4fa-583f-4e20-9e03-ac9c3926e1c6]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5197834c-680b-45db-b26b-fc57868fabba" returned: 0 in 0.774s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-5197834c-680b-45db-b26b-fc57868fabba" released by "delete_volume" :: held 2.087s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:23 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:23 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Created reservations ['f939c8eb-cefc-405c-ad2d-57e54046e402', 'c2ad1314-2a76-49b3-ab3b-6feb0e75a590', '1bf07177-6ec1-4812-ba2d-f6a516c6244a', 'b0e1ac7c-6981-4d05-a168-d12132885a0c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:23 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:09:23 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 1.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:24 devstack sudo[93630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 1G Sep 28 16:09:24 devstack sudo[93630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:24 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.893s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Deleted volume successfully. Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b6f1588f-d8a9-4812-9fb9-92ab59da3104 tempest-VolumesTestJSON-2034926101 None] Lock "cinder-5197834c-680b-45db-b26b-fc57868fabba-delete_volume" released by "delete_volume" :: held 3.779s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-0d9d364b-798c-4ad1-b434-3d8c39ce9428-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "cinder-0d9d364b-798c-4ad1-b434-3d8c39ce9428-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Acquiring lock "cinder-quobyte-0d9d364b-798c-4ad1-b434-3d8c39ce9428" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-0d9d364b-798c-4ad1-b434-3d8c39ce9428" acquired by "delete_volume" :: waited 0.090s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33433b2-a250-4350-a659-216cf8ec8f2d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 Sep 28 16:09:25 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:25 devstack sudo[93630]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 1G" returned: 0 in 1.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:25 devstack sudo[93647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 Sep 28 16:09:25 devstack sudo[93647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428" returned: 0 in 0.858s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428 Sep 28 16:09:26 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[93647]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 is being set with open permissions: ugo+rw Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:26 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 Sep 28 16:09:26 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:26 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0d9d364b-798c-4ad1-b434-3d8c39ce9428" returned: 0 in 0.786s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "cinder-quobyte-0d9d364b-798c-4ad1-b434-3d8c39ce9428" released by "delete_volume" :: held 1.853s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Created reservations ['7a9c0338-76ec-4702-81f4-ea0a39db1a3d', '56e66cb2-20e1-43af-ae94-0fc905335485', 'fab21331-c8ce-4508-b1df-bce14fca197d', 'a900818b-e38b-48f0-87a1-e8ca919487ce'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:27 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73" returned: 0 in 0.977s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:27 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:09:27 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.885s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-251a3069-08fb-4191-a6c5-e3323b1c50dc tempest-SnapshotsActionsTest-1761365102 None] Create snapshot completed successfully Sep 28 16:09:28 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.683s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Deleted volume successfully. Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3d8f6d73-469b-439e-97d7-9b931400901a tempest-VolumesTestJSON-2034926101 None] Lock "cinder-0d9d364b-798c-4ad1-b434-3d8c39ce9428-delete_volume" released by "delete_volume" :: held 3.428s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-5b371254-3d6e-4295-aa57-d4a7d2c9dc73-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-5b371254-3d6e-4295-aa57-d4a7d2c9dc73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-5b371254-3d6e-4295-aa57-d4a7d2c9dc73" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-5b371254-3d6e-4295-aa57-d4a7d2c9dc73" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Deleting offline snapshot 5b371254-3d6e-4295-aa57-d4a7d2c9dc73 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] snapshot_file for this snap is: volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70e070a-4344-49cd-92f2-d8bd18c53278]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[93726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 Sep 28 16:09:29 devstack sudo[93726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:29 devstack sudo[93726]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73" returned: 0 in 0.645s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d7d302-43d5-4375-9df7-ddce4d2ab556]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:29 devstack sudo[93736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:29 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:30 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.613s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:30 devstack sudo[93760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 Sep 28 16:09:30 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73" returned: 0 in 0.954s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:31 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73 Sep 28 16:09:31 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:31 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5b371254-3d6e-4295-aa57-d4a7d2c9dc73" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-5b371254-3d6e-4295-aa57-d4a7d2c9dc73" released by "_delete_snapshot" :: held 2.889s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_snapshot" :: held 2.935s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Created reservations ['70fed68f-4a43-4dea-8454-a3845a9059e8', 'aaf056f1-dded-4849-8519-2b18aa01081a', 'e4dac3b6-a4e1-461e-a461-a6f88b1df161', '6bce5935-4a39-41e4-ac21-0358f3747bf4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Delete snapshot completed successfully. Sep 28 16:09:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-316d585c-a967-4ce8-9eca-59cb2d7064ad tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-5b371254-3d6e-4295-aa57-d4a7d2c9dc73-delete_snapshot" released by "delete_snapshot" :: held 3.154s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Creating offline snapshot 8fbf4f44-278a-4e79-b909-d80440d1cd11 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b7f84-793e-4292-b3bf-a7473edab7d1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack sudo[93868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:33 devstack sudo[93868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:33 devstack sudo[93868]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.865s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:33 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 1G Sep 28 16:09:33 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:35 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 1G" returned: 0 in 1.236s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:35 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 Sep 28 16:09:35 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:35 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11" returned: 0 in 0.720s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 is being set with open permissions: ugo+rw Sep 28 16:09:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:35 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 Sep 28 16:09:35 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11" returned: 0 in 0.528s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.690s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:36 devstack sudo[93897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:09:36 devstack sudo[93897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b051a2eb-c737-4e92-8ec3-4daf27416ca7 tempest-SnapshotsActionsTest-1761365102 None] Create snapshot completed successfully Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Acquiring lock "cinder-681e0f69-da42-4219-84ea-23df42ac44f3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "cinder-681e0f69-da42-4219-84ea-23df42ac44f3-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Acquiring lock "cinder-quobyte-681e0f69-da42-4219-84ea-23df42ac44f3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "cinder-quobyte-681e0f69-da42-4219-84ea-23df42ac44f3" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4198a-8536-419a-9f99-1794ce511284]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:37 devstack sudo[93897]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.784s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-8fbf4f44-278a-4e79-b909-d80440d1cd11-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:37 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 Sep 28 16:09:37 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-8fbf4f44-278a-4e79-b909-d80440d1cd11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_snapshot" :: waited 0.061s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-8fbf4f44-278a-4e79-b909-d80440d1cd11" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-8fbf4f44-278a-4e79-b909-d80440d1cd11" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Deleting offline snapshot 8fbf4f44-278a-4e79-b909-d80440d1cd11 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] snapshot_file for this snap is: volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73200f8a-b886-475f-89f0-869c55d7c842]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:38 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 Sep 28 16:09:38 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:38 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3" returned: 0 in 1.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:38 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3 Sep 28 16:09:38 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11" returned: 0 in 1.210s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a55190-4c60-4322-8ff6-969a2af73852]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-681e0f69-da42-4219-84ea-23df42ac44f3" returned: 0 in 0.686s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "cinder-quobyte-681e0f69-da42-4219-84ea-23df42ac44f3" released by "delete_volume" :: held 2.291s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Created reservations ['b89f2688-4a92-4977-b6db-f9d56d5aed1c', 'b54ad8e7-1e47-44d0-8ecc-ab6a7bb2cb09', '203cfc7b-edaf-4f8e-a5be-a677ab9d5b7d', '19cbfa6b-0e27-4111-b5b8-92d8c5d8d4fc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:39 devstack sudo[93915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:39 devstack sudo[93915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:39 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:09:39 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[93915]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 1.128s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:40 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 Sep 28 16:09:40 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:40 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.740s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:09:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Deleted volume successfully. Sep 28 16:09:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-54b45e66-7263-445a-97b1-8dd4a0aa2d95 tempest-ServerRescueNegativeTestJSON-2145613559 None] Lock "cinder-681e0f69-da42-4219-84ea-23df42ac44f3-delete_volume" released by "delete_volume" :: held 3.741s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:41 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11" returned: 0 in 1.011s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:41 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11 Sep 28 16:09:41 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:42 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.8fbf4f44-278a-4e79-b909-d80440d1cd11" returned: 0 in 0.832s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-8fbf4f44-278a-4e79-b909-d80440d1cd11" released by "_delete_snapshot" :: held 4.543s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_snapshot" :: held 4.627s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Created reservations ['e33da302-92a5-4f6f-b260-fef8b7ec0d96', '72e577aa-dc6b-493a-8267-ee16f9c29344', '4d349cc0-1508-43f3-9468-b1c88c52d6a3', '125d8ac2-e9a6-4380-9a30-2700a84b29b1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Delete snapshot completed successfully. Sep 28 16:09:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539b9691-037f-4c96-9a71-40449d2d94f4 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-8fbf4f44-278a-4e79-b909-d80440d1cd11-delete_snapshot" released by "delete_snapshot" :: held 5.344s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Creating offline snapshot 5af0a484-861e-4de1-b2f1-226a7cbd63b0 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac3152-0c0f-441a-9d36-b40fb85cdcbe]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:44 devstack sudo[93964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:44 devstack sudo[93964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:45 devstack sudo[93964]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.977s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:45 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 1G Sep 28 16:09:45 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:46 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 1G" returned: 0 in 0.969s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:46 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 Sep 28 16:09:46 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0" returned: 0 in 0.816s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:47 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 is being set with open permissions: ugo+rw Sep 28 16:09:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:47 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 Sep 28 16:09:47 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:47 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b1c8fcd0-1672-49af-bf04-e9bb38756356 tempest-SnapshotsActionsTest-1761365102 None] Create snapshot completed successfully Sep 28 16:09:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-5af0a484-861e-4de1-b2f1-226a7cbd63b0-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-5af0a484-861e-4de1-b2f1-226a7cbd63b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-5af0a484-861e-4de1-b2f1-226a7cbd63b0" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-5af0a484-861e-4de1-b2f1-226a7cbd63b0" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Deleting offline snapshot 5af0a484-861e-4de1-b2f1-226a7cbd63b0 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] snapshot_file for this snap is: volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21c7bd-a45a-46b7-b3ea-6b6d9696e411]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 Sep 28 16:09:49 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:49 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0" returned: 0 in 0.643s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[81596758-8a64-483f-a350-4a3ccf8bdd66]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:49 devstack sudo[94034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:49 devstack sudo[94034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:50 devstack sudo[94034]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.620s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:50 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 Sep 28 16:09:50 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:51 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0" returned: 0 in 0.740s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:51 devstack sudo[94047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0 Sep 28 16:09:51 devstack sudo[94047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:51 devstack sudo[94047]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.5af0a484-861e-4de1-b2f1-226a7cbd63b0" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-5af0a484-861e-4de1-b2f1-226a7cbd63b0" released by "_delete_snapshot" :: held 2.692s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_snapshot" :: held 2.752s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:51 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Created reservations ['a1c00426-518a-468c-b90c-b676d81f43a3', 'ed27676c-4dfa-4863-b38a-5b7bb7d44571', 'e70a5a65-6e35-43b4-99f9-bd5a435c26df', '080f500f-37a1-491e-9373-0724c0d15dc6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Delete snapshot completed successfully. Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ebfeb5ee-5f84-4c30-9f8f-153dd0e58df7 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-5af0a484-861e-4de1-b2f1-226a7cbd63b0-delete_snapshot" released by "delete_snapshot" :: held 3.068s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Creating offline snapshot 3d172736-7aa0-434c-bfb3-921c41bbcce3 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe3a75-719a-4e41-b2d2-fb897341b395]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:52 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:52 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:53 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.550s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:53 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 1G Sep 28 16:09:53 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 1G" returned: 0 in 0.670s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[94091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 Sep 28 16:09:54 devstack sudo[94091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:54 devstack sudo[94091]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3" returned: 0 in 0.683s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:54 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 is being set with open permissions: ugo+rw Sep 28 16:09:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:54 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 Sep 28 16:09:54 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:55 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3" returned: 0 in 0.338s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.400s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:09:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bcd7898d-8124-46af-833c-42d95f299d85 tempest-SnapshotsActionsTest-1761365102 None] Create snapshot completed successfully Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-3d172736-7aa0-434c-bfb3-921c41bbcce3-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-3d172736-7aa0-434c-bfb3-921c41bbcce3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Acquiring lock "cinder-quobyte-3d172736-7aa0-434c-bfb3-921c41bbcce3" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-3d172736-7aa0-434c-bfb3-921c41bbcce3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Deleting offline snapshot 3d172736-7aa0-434c-bfb3-921c41bbcce3 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] snapshot_file for this snap is: volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860b56a-f96f-423c-93e4-5bbf5c5075e2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:56 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 Sep 28 16:09:56 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:56 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3" returned: 0 in 0.487s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c580ecf0-a803-44d8-9192-51ab7d542a87]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:09:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:56 devstack sudo[94143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:09:56 devstack sudo[94143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack sudo[94143]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:57 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 Sep 28 16:09:57 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:57 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:09:57 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3 Sep 28 16:09:57 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:09:58 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 28 16:09:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.3d172736-7aa0-434c-bfb3-921c41bbcce3" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-3d172736-7aa0-434c-bfb3-921c41bbcce3" released by "_delete_snapshot" :: held 2.275s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_snapshot" :: held 2.305s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:09:58 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Created reservations ['b481d93f-af67-4374-bd4c-4df9f31f0b31', '06fa7bec-c94e-4830-bb1f-d2ba625f6b8f', '5b287274-2c20-45df-ae1b-e5c575e87ef1', '26774b37-aef7-4b62-9115-7a9e0d411cd3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:09:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Delete snapshot completed successfully. Sep 28 16:09:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-76faf789-3e22-4677-a961-41d67fc1b2f8 tempest-SnapshotsActionsTest-588824425 None] Lock "cinder-3d172736-7aa0-434c-bfb3-921c41bbcce3-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=57,cinder:UPDATE=70,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a3ec0d3-5c9a-4fec-884e-6845a9fced19 tempest-GroupsV314Test-569704584 None] Group tempest-GroupsV314Test-Group-1027933857: creating Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=69,cinder:UPDATE=80,cinder:INSERT=18,cinder:DELETE=10 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a3ec0d3-5c9a-4fec-884e-6845a9fced19 tempest-GroupsV314Test-569704584 None] Group tempest-GroupsV314Test-Group-1027933857: created successfully Sep 28 16:10:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3a3ec0d3-5c9a-4fec-884e-6845a9fced19 tempest-GroupsV314Test-569704584 None] Create group completed successfully. Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (0b46deda-ad26-49a2-a6b1-d98f70ba2606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75f4cb2-2944-413f-9a44-35a146513501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "cinder-cdcde6b4-fa42-4774-82c1-de68d66e9172-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c75f4cb2-2944-413f-9a44-35a146513501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1427332035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48116cfd-e86e-41f2-ad9d-2058693da863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:01Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2bf17e-0cce-4ad2-8a66-1b62062c54f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2bf17e-0cce-4ad2-8a66-1b62062c54f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34084ba7-cef5-41c7-abfe-73b8beec8e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34084ba7-cef5-41c7-abfe-73b8beec8e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48116cfd-e86e-41f2-ad9d-2058693da863', 'volume_name': 'volume-48116cfd-e86e-41f2-ad9d-2058693da863', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b32ea94-ce90-4514-a9cb-d171d22423cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b32ea94-ce90-4514-a9cb-d171d22423cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19e0e3-82bd-458f-b576-cfc13a39d074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Volume 48116cfd-e86e-41f2-ad9d-2058693da863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48116cfd-e86e-41f2-ad9d-2058693da863', 'volume_size': 1} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1427332035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48116cfd-e86e-41f2-ad9d-2058693da863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:01Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Creating volume 48116cfd-e86e-41f2-ad9d-2058693da863 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-cdcde6b4-fa42-4774-82c1-de68d66e9172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.096s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "cinder-quobyte-cdcde6b4-fa42-4774-82c1-de68d66e9172" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:00 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 1073741824 Sep 28 16:10:00 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-cdcde6b4-fa42-4774-82c1-de68d66e9172" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Deleting offline snapshot cdcde6b4-fa42-4774-82c1-de68d66e9172 of volume bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] snapshot_file for this snap is: volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5116ccf1-52fb-45a8-8ff9-376b98a73bd4]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:01 devstack sudo[94165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:10:01 devstack sudo[94165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:01 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 1073741824" returned: 0 in 0.783s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:01 devstack sudo[94165]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.731s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd54d90c-2281-4adf-bf48-28296490d6d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4abba1e-a59d-4e7a-9b62-ef9e7d7605de]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:01 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 Sep 28 16:10:01 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:02 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 Sep 28 16:10:02 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:02 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863" returned: 0 in 0.562s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c19e0e3-82bd-458f-b576-cfc13a39d074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48116cfd-e86e-41f2-ad9d-2058693da863', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a77e73-6108-48b2-aed7-390d9a569a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Volume volume-48116cfd-e86e-41f2-ad9d-2058693da863 (48116cfd-e86e-41f2-ad9d-2058693da863): created successfully Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14a77e73-6108-48b2-aed7-390d9a569a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (0b46deda-ad26-49a2-a6b1-d98f70ba2606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6079ab97-b058-4e71-92ce-702a84d56170 tempest-AttachVolumeTestJSON-598052386 None] Created volume successfully. Sep 28 16:10:02 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8" returned: 0 in 0.842s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:02 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:10:02 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Flow 'volume_create_manager' (2a657ac7-cbbd-4ef8-804b-4abd179bbed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b375c76-be3d-4cf0-8d78-1e1f9556b6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b375c76-be3d-4cf0-8d78-1e1f9556b6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1079917606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87c13dff-b542-4a39-aa5c-2497483b74c9,host='devstack@QuobyteHD#QuobyteHD',id=87a04bc3-ef02-4237-9b75-57a6f9c1d12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0bc2fbad2d42e0b380860f6d064b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:02Z,use_quota=True,user_id='c22cb17d56454ae695a8f97a89562d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77aac99-9549-4f9a-947b-76a05296521a),volume_type_id=c77aac99-9549-4f9a-947b-76a05296521a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec21bfe-3065-4da4-ba2d-dd44010481c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ec21bfe-3065-4da4-ba2d-dd44010481c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ddc7e4-40d3-4371-a35e-5c70a178a092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ddc7e4-40d3-4371-a35e-5c70a178a092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a04bc3-ef02-4237-9b75-57a6f9c1d12f', 'volume_name': 'volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6020e7-506b-40d9-ba84-01f486491ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b6020e7-506b-40d9-ba84-01f486491ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c8a66a-a9ba-449b-940c-eb9ec76fba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Volume 87a04bc3-ef02-4237-9b75-57a6f9c1d12f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f', 'volume_size': 1} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=87c13dff-b542-4a39-aa5c-2497483b74c9,created_at=2026-09-28T14:10:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1079917606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=87c13dff-b542-4a39-aa5c-2497483b74c9,host='devstack@QuobyteHD#QuobyteHD',id=87a04bc3-ef02-4237-9b75-57a6f9c1d12f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef0bc2fbad2d42e0b380860f6d064b5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:02Z,use_quota=True,user_id='c22cb17d56454ae695a8f97a89562d5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c77aac99-9549-4f9a-947b-76a05296521a),volume_type_id=c77aac99-9549-4f9a-947b-76a05296521a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Creating volume 87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:03 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f 1073741824 Sep 28 16:10:03 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:03 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.743s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:03 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172 Sep 28 16:10:03 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:03 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8.cdcde6b4-fa42-4774-82c1-de68d66e9172" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:04 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f 1073741824" returned: 0 in 1.040s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-cdcde6b4-fa42-4774-82c1-de68d66e9172" released by "_delete_snapshot" :: held 3.129s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_snapshot" :: held 3.174s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:04 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:04 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Created reservations ['8633998c-9e09-41f2-af2c-245d102cb649', 'a731c036-eb94-4bac-a350-730f710dfe61', 'e05a237c-28c4-48d8-a9ac-651764d70502', '0ac1ca33-737f-4e58-bd20-884a3cf579e0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Delete snapshot completed successfully. Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9fd1c31e-4f4d-436f-a05f-601531d2257e tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-cdcde6b4-fa42-4774-82c1-de68d66e9172-delete_snapshot" released by "delete_snapshot" :: held 3.648s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:04 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.660s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5c8a66a-a9ba-449b-940c-eb9ec76fba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f591e1-e3b6-4d27-8fc3-557f964f6ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Volume volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f (87a04bc3-ef02-4237-9b75-57a6f9c1d12f): created successfully Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f591e1-e3b6-4d27-8fc3-557f964f6ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Flow 'volume_create_manager' (2a657ac7-cbbd-4ef8-804b-4abd179bbed0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e3d09492-2028-42a5-8eda-ee4210677d2d tempest-GroupsV314Test-569704584 None] Created volume successfully. Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-eb80ff10-c784-4223-abbf-be685fd20e93 req-c1712643-35c8-471c-960f-37bee039a742 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-eb80ff10-c784-4223-abbf-be685fd20e93 req-c1712643-35c8-471c-960f-37bee039a742 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-eb80ff10-c784-4223-abbf-be685fd20e93 req-c1712643-35c8-471c-960f-37bee039a742 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-eb80ff10-c784-4223-abbf-be685fd20e93 req-c1712643-35c8-471c-960f-37bee039a742 tempest-AttachVolumeTestJSON-598052386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-48116cfd-e86e-41f2-ad9d-2058693da863', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddf8f7dd-0f43-4d19-b251-ac5e3d383a2f', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:10:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-eb80ff10-c784-4223-abbf-be685fd20e93 req-c1712643-35c8-471c-960f-37bee039a742 tempest-AttachVolumeTestJSON-598052386 None] attachment_update completed successfully. Sep 28 16:10:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "cinder-bd54d90c-2281-4adf-bf48-28296490d6d8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7af7dc8e-1a98-4a8f-9063-cceeddbb8d72 tempest-BackendsCapabilitiesAdminTestsJSON-1841986662 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.145206451416, 'free_capacity_gb': 1775.145206451416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-bd54d90c-2281-4adf-bf48-28296490d6d8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4b671e44-1b11-4604-853c-62b56b736e31 tempest-BackendsCapabilitiesAdminTestsJSON-1841986662 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.145206451416, 'free_capacity_gb': 1775.145206451416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b017e16-718e-4e53-b6ae-daa73bcb5366]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:06 devstack sudo[94641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 Sep 28 16:10:06 devstack sudo[94641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Cloning volume 87a04bc3-ef02-4237-9b75-57a6f9c1d12f to volume a79e2896-dbdd-4ba5-a3e9-d78beb552b39 Sep 28 16:10:07 devstack sudo[94641]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8" returned: 0 in 0.869s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Creating offline snapshot 15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 of volume 87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:07 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8 Sep 28 16:10:07 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6576d4d0-5173-48d7-99ab-46df87f021a1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:07 devstack sudo[94648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:07 devstack sudo[94648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:07 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd54d90c-2281-4adf-bf48-28296490d6d8" returned: 0 in 0.546s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-quobyte-bd54d90c-2281-4adf-bf48-28296490d6d8" released by "delete_volume" :: held 1.547s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Created reservations ['625e509d-89b7-4f69-bf9e-af22d9c22dad', '08d9edf5-a938-4252-96b6-4e9d752e1d6e', 'e9227f94-27d9-42b8-97cc-97933d660c86', '1a16ba2a-e0eb-4c7c-a278-accf1bf3b34d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:08 devstack sudo[94648]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.845s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:08 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:08 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:08 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 1G Sep 28 16:10:08 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:08 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Deleted volume successfully. Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c90a92b2-d775-4c42-9faa-b180220887c3 tempest-SnapshotsActionsTest-1761365102 None] Lock "cinder-bd54d90c-2281-4adf-bf48-28296490d6d8-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:08 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 1G" returned: 0 in 0.754s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:08 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:08 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.493s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:09 devstack sudo[94683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:09 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:09 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.447s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:09 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info Sep 28 16:10:09 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:10 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info" returned: 0 in 0.465s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:10 devstack sudo[94691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info Sep 28 16:10:10 devstack sudo[94691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:10 devstack sudo[94691]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.info" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Acquiring lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] snapshot: 15f405f8-42fd-4fdf-8f73-bf6d6651f0c2, volume: a79e2896-dbdd-4ba5-a3e9-d78beb552b39, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[788b77bd-4389-44dc-a75a-1daa6b7b7a1c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:11 devstack sudo[94694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:11 devstack sudo[94694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:11 devstack sudo[94694]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.579s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a662e891-6ed2-4bd4-9152-0e5583128048]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:11 devstack sudo[94700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:11 devstack sudo[94700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:12 devstack sudo[94700]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:10:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:10:12 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:10:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:12 devstack sudo[94705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 Sep 28 16:10:12 devstack sudo[94705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:19 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=30,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:19 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=25,cinder:SELECT=24,cinder:INSERT=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:10:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bfc73e3a-7448-41d3-a168-18426a587152 tempest-GroupSnapshotsV319Test-477174649 None] Group tempest-GroupSnapshotsV319Test-Group-1050810032: creating Sep 28 16:10:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bfc73e3a-7448-41d3-a168-18426a587152 tempest-GroupSnapshotsV319Test-477174649 None] Group tempest-GroupSnapshotsV319Test-Group-1050810032: created successfully Sep 28 16:10:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bfc73e3a-7448-41d3-a168-18426a587152 tempest-GroupSnapshotsV319Test-477174649 None] Create group completed successfully. Sep 28 16:10:27 devstack sudo[94705]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" returned: 0 in 15.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f, size 1024.00 MB, duration 15.33 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:10:27 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Converted 1024.00 MB image at 66.81 MB/s Sep 28 16:10:27 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:27 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 Sep 28 16:10:27 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Flow 'volume_create_manager' (21d817f2-8374-444b-b1d2-7d39e1f422cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2259151-67aa-48c2-a88d-d9e85f9620dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2259151-67aa-48c2-a88d-d9e85f9620dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1925060959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=053ad8fb-1a0b-4d98-8c9d-fe9de8ade640,host='devstack@QuobyteHD#QuobyteHD',id=9c14db08-9e1d-462f-b8b0-0e9929dc9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b66cbb9df40629cf50f4d53253fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:27Z,use_quota=True,user_id='80336683ee264dcaa733475f8d775dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cca68bd-a3b0-435c-b169-0817089ac560),volume_type_id=6cca68bd-a3b0-435c-b169-0817089ac560)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f799bb-522e-4714-a937-03718f9dbb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2f799bb-522e-4714-a937-03718f9dbb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6971b28f-5ce3-4cf1-bbcb-45c1c1bf1cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6971b28f-5ce3-4cf1-bbcb-45c1c1bf1cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c14db08-9e1d-462f-b8b0-0e9929dc9af2', 'volume_name': 'volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2999e77-a0c8-401e-ae02-78a4eccc7ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2999e77-a0c8-401e-ae02-78a4eccc7ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c5d516-21c7-4fae-a1d3-68d3470b3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Volume 9c14db08-9e1d-462f-b8b0-0e9929dc9af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2', 'volume_size': 1} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:27 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" returned: 0 in 0.497s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" released by "_copy_volume_from_snapshot" :: held 17.119s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Acquiring lock "cinder-quobyte-15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Deleting offline snapshot 15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 of volume 87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] snapshot_file for this snap is: volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a43cb6-8919-4946-b118-edf7eb209c2d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:28 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:28 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:28 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e23a40-dda9-48d5-8bf5-fac8f607a65b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:28 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:28 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Flow 'volume_create_manager' (ebb942fb-cedc-4b73-8a7b-f0f9f79696cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99510abe-13f6-4fe6-95a1-dbdc47b5ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99510abe-13f6-4fe6-95a1-dbdc47b5ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1078240312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7699c-6d78-4c1d-a53b-250ff99f2ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e37cf8f3a84e2c8d03ce568091f216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:29Z,use_quota=True,user_id='41aebdb3562d4d5bae5309eb3be9d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31f5aab1-1324-492d-90d6-7dd1d0dff5d0),volume_type_id=31f5aab1-1324-492d-90d6-7dd1d0dff5d0)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8956a7de-3592-40e4-88d6-6f2310a58d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8956a7de-3592-40e4-88d6-6f2310a58d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a81ce1e-30f3-49c9-be87-e4b52bd15c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a81ce1e-30f3-49c9-be87-e4b52bd15c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d7699c-6d78-4c1d-a53b-250ff99f2ebb', 'volume_name': 'volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a65b4e-ea6c-42b4-a9af-e0c813e7b133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71a65b4e-ea6c-42b4-a9af-e0c813e7b133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f23634-3334-4dc9-ad97-1eb78cde19e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Volume 91d7699c-6d78-4c1d-a53b-250ff99f2ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb', 'volume_size': 1} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:29 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.928s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:29 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:29 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:30 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.527s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:30 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2 Sep 28 16:10:30 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:30 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f.15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-15f405f8-42fd-4fdf-8f73-bf6d6651f0c2" released by "_delete_snapshot" :: held 2.602s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 23.718s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.898s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=053ad8fb-1a0b-4d98-8c9d-fe9de8ade640,created_at=2026-09-28T14:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1925060959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=053ad8fb-1a0b-4d98-8c9d-fe9de8ade640,host='devstack@QuobyteHD#QuobyteHD',id=9c14db08-9e1d-462f-b8b0-0e9929dc9af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b14b66cbb9df40629cf50f4d53253fec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:27Z,use_quota=True,user_id='80336683ee264dcaa733475f8d775dce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cca68bd-a3b0-435c-b169-0817089ac560),volume_type_id=6cca68bd-a3b0-435c-b169-0817089ac560)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Creating volume 9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:10:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:30 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 1073741824 Sep 28 16:10:30 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-19088f1b-d311-491d-9b1b-72124f4a421b tempest-GroupsV314Test-569704584 None] Create group from source-group-87c13dff-b542-4a39-aa5c-2497483b74c9 completed successfully. Sep 28 16:10:31 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 1073741824" returned: 0 in 0.650s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:31 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 Sep 28 16:10:31 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:31 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" returned: 0 in 0.452s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.307s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1078240312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d7699c-6d78-4c1d-a53b-250ff99f2ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='28e37cf8f3a84e2c8d03ce568091f216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:29Z,use_quota=True,user_id='41aebdb3562d4d5bae5309eb3be9d527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31f5aab1-1324-492d-90d6-7dd1d0dff5d0),volume_type_id=31f5aab1-1324-492d-90d6-7dd1d0dff5d0)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Creating volume 91d7699c-6d78-4c1d-a53b-250ff99f2ebb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:10:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:31 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb 1073741824 Sep 28 16:10:31 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c5d516-21c7-4fae-a1d3-68d3470b3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dc0071-aa64-4da7-abe0-5478e026b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Volume volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 (9c14db08-9e1d-462f-b8b0-0e9929dc9af2): created successfully Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dc0071-aa64-4da7-abe0-5478e026b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Flow 'volume_create_manager' (21d817f2-8374-444b-b1d2-7d39e1f422cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-88f8556b-fd1b-4d79-a162-729798a0d882 tempest-GroupSnapshotsV319Test-477174649 None] Created volume successfully. Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Acquiring lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b42478-8608-402c-a5e6-3d8e5f23aa60]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:32 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 Sep 28 16:10:32 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:32 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb 1073741824" returned: 0 in 0.786s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:32 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb Sep 28 16:10:32 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:33 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" returned: 0 in 0.587s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:33 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39 Sep 28 16:10:33 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:33 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f23634-3334-4dc9-ad97-1eb78cde19e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70736777-6964-458f-87de-0b7ebbee852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Volume volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb (91d7699c-6d78-4c1d-a53b-250ff99f2ebb): created successfully Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70736777-6964-458f-87de-0b7ebbee852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Flow 'volume_create_manager' (ebb942fb-cedc-4b73-8a7b-f0f9f79696cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7eee86cf-733b-4df2-bbea-176267f640b6 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Created volume successfully. Sep 28 16:10:33 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" returned: 0 in 0.340s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-a79e2896-dbdd-4ba5-a3e9-d78beb552b39" released by "delete_volume" :: held 0.997s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Created reservations ['7f9166c6-0814-4901-9657-d38696275e1c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:33 devstack cinder-volume[87150]: WARNING cinder.quota [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-616974966 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-616974966, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:33 devstack cinder-volume[87150]: WARNING cinder.quota [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-616974966 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-616974966, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Created reservations ['f9e8aad6-9632-4dc0-ab4b-7bc03a7ab046', '7a899d5a-64cd-416a-b326-944c25371df2', '9f6adbba-de6f-413a-9a13-91a160f37316', '084f1497-82c5-4185-b1cb-defc5bdf76e9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] GroupSnapshot 61e36577-b390-4f7d-90f4-d86d42112857: creating. Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Group snapshot 61e36577-b390-4f7d-90f4-d86d42112857: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Creating offline snapshot f9cb98aa-68b2-47ff-8dd2-c95d753ab260 of volume 9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ac7ccf-c17c-47f8-8999-fb4b8e06022c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:34 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:34 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 Sep 28 16:10:34 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:34 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-88ff6b84-068c-48bf-b781-151e1e392ecf tempest-GroupsV314Test-569704584 None] Delete group completed successfully. Sep 28 16:10:34 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" returned: 0 in 0.733s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 1G Sep 28 16:10:34 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:34 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:34 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:35 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 1G" returned: 0 in 0.634s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b5214b85-6b7f-41a2-9f6c-53c69208ab03 tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Retype volume completed successfully. Sep 28 16:10:35 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 Sep 28 16:10:35 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Acquiring lock "cinder-quobyte-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c1826a-485c-4470-a53e-439af7fc3d6e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:35 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:35 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:35 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260" returned: 0 in 0.661s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:10:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:35 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 Sep 28 16:10:35 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "cinder-91d7699c-6d78-4c1d-a53b-250ff99f2ebb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:36 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "cinder-91d7699c-6d78-4c1d-a53b-250ff99f2ebb-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.869s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:36 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f Sep 28 16:10:36 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:36 devstack sudo[95389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:36 devstack sudo[95389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "cinder-quobyte-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "cinder-quobyte-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" acquired by "delete_volume" :: waited 0.062s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:36 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260" returned: 0 in 0.833s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfad34ff-fe37-4911-9a66-fe6515fa44fc]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:36 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info Sep 28 16:10:36 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:36 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" returned: 0 in 0.591s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Lock "cinder-quobyte-87a04bc3-ef02-4237-9b75-57a6f9c1d12f" released by "delete_volume" :: held 1.588s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:37 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb Sep 28 16:10:37 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:37 devstack sudo[95389]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.729s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Created reservations ['67be6a26-9068-4f2b-ba02-3d74b62478a5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:37 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[95399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info Sep 28 16:10:37 devstack sudo[95399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Created reservations ['e0245c68-a8c7-43f4-9dd9-5054149a767e', 'a06cfae1-bf91-4276-a70c-c092a5aa1cf4', '934da165-4c90-4acd-a4ac-88e43e91a22b', '056400fc-9568-461a-8c0f-be7612cf4805'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" returned: 0 in 0.923s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:37 devstack sudo[95404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:37 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb Sep 28 16:10:37 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:37 devstack sudo[95404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:37 devstack sudo[95399]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.info" returned: 0 in 0.557s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.153s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a29b1b69-e066-4562-85e9-484b9604c7d4 tempest-GroupSnapshotsV319Test-477174649 None] group_snapshot 61e36577-b390-4f7d-90f4-d86d42112857: created successfully Sep 28 16:10:38 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" returned: 0 in 0.562s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:38 devstack sudo[95404]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "cinder-quobyte-91d7699c-6d78-4c1d-a53b-250ff99f2ebb" released by "delete_volume" :: held 1.628s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a4120a93-829c-4f2d-9c74-c6510f02e782 tempest-GroupsV314Test-569704584 None] Delete group completed successfully. Sep 28 16:10:38 devstack cinder-volume[87150]: WARNING cinder.quota [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:38 devstack cinder-volume[87150]: WARNING cinder.quota [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Created reservations ['621c298a-853a-495e-859c-ed40624bd296', '982c2718-76cf-453b-b6ca-7a5c1275f862', '2ae5c73c-1166-4614-9839-786044b7a4de', '9c6b1dbc-d12f-4165-a5b9-37bc3cd6601a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:38 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:38 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:39 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.571s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Deleted volume successfully. Sep 28 16:10:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4ed88eb7-3c58-4688-add4-974a90560e2a tempest-VolumeRetypeWithoutMigrationTest-1961388469 None] Lock "cinder-91d7699c-6d78-4c1d-a53b-250ff99f2ebb-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] group_snapshot 61e36577-b390-4f7d-90f4-d86d42112857: deleting Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] group_snapshot 61e36577-b390-4f7d-90f4-d86d42112857: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "cinder-quobyte-f9cb98aa-68b2-47ff-8dd2-c95d753ab260" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-f9cb98aa-68b2-47ff-8dd2-c95d753ab260" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Deleting offline snapshot f9cb98aa-68b2-47ff-8dd2-c95d753ab260 of volume 9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] snapshot_file for this snap is: volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a848a28-448a-4417-b5ef-5705a2634d81]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:40 devstack sudo[95435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 Sep 28 16:10:40 devstack sudo[95435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:40 devstack sudo[95435]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260" returned: 0 in 0.628s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a40daa7-e4dc-4ab0-bf4d-7395688b026c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:41 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 Sep 28 16:10:41 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:41 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" returned: 0 in 0.768s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:41 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 Sep 28 16:10:41 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260" returned: 0 in 0.576s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:42 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260 Sep 28 16:10:42 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:42 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2.f9cb98aa-68b2-47ff-8dd2-c95d753ab260" returned: 0 in 0.511s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-f9cb98aa-68b2-47ff-8dd2-c95d753ab260" released by "_delete_snapshot" :: held 2.724s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" released by "delete_snapshot" :: held 2.776s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:43 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428415674 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1428415674, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:43 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428415674 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1428415674, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] Created reservations ['98959330-6b4a-4324-aefc-1ee20c44b7bd', '3a118477-b134-4f9b-b564-8dcd3d712429', 'd0c5d9d9-6a5b-45dc-8a35-77ca71c195f5', '1bce2927-8a33-40ae-8f0c-1b6d7913c8fe'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6233ded2-c07d-4546-b7f6-33fe1e9a1ddb tempest-GroupSnapshotsV319Test-477174649 None] group_snapshot 61e36577-b390-4f7d-90f4-d86d42112857: deleted successfully Sep 28 16:10:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7384d639-7579-4573-b2c4-bd3f08280168]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:44 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 Sep 28 16:10:44 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:45 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" returned: 0 in 0.643s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:45 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2 Sep 28 16:10:45 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:45 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Lock "cinder-quobyte-9c14db08-9e1d-462f-b8b0-0e9929dc9af2" released by "delete_volume" :: held 1.220s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Created reservations ['1cbd895f-5247-4c67-ac8d-f4870fad0105'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:45 devstack cinder-volume[87150]: WARNING cinder.quota [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1428415674 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1428415674, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Created reservations ['18db65f5-4c61-4904-a297-9f76557f8611', '26855c06-3c5a-4679-a732-229b84471750', '255a89a4-56a2-43a6-b7b1-0ce0644af6b0', '88a7a6f3-ec48-4b2b-9406-d433710340db'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:46 devstack sudo[95463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:46 devstack sudo[95463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:46 devstack sudo[95463]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-776c82ce-02dc-4f54-ad2d-04231252a986 tempest-GroupSnapshotsV319Test-477174649 None] Delete group completed successfully. Sep 28 16:10:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-1414535b-1672-418b-959f-5a4660828bf4 req-cd3d2a76-f968-434a-9d9e-cfd0f7df6233 tempest-AttachVolumeTestJSON-598052386 None] Terminate volume connection completed successfully. Sep 28 16:10:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-1414535b-1672-418b-959f-5a4660828bf4 req-cd3d2a76-f968-434a-9d9e-cfd0f7df6233 tempest-AttachVolumeTestJSON-598052386 None] Deleting attachment ddf8f7dd-0f43-4d19-b251-ac5e3d383a2f. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Flow 'volume_create_manager' (01d12cf8-703f-4fb5-bca6-b4137b516ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edff977-2e96-40a9-b5e4-94e60b8f4074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2edff977-2e96-40a9-b5e4-94e60b8f4074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-81995167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47315d8-74e5-493d-80d2-705b80cfd063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fcd9c7a68d43c88f1a1931a3c043b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:53Z,use_quota=True,user_id='01f85b190a744bcfa967531e829b11b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7665b6ae-b923-4d19-a28c-e9a1eb5fd98c),volume_type_id=7665b6ae-b923-4d19-a28c-e9a1eb5fd98c)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d65bf0-4b29-42ab-95db-b4f00e46fd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28d65bf0-4b29-42ab-95db-b4f00e46fd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a297ad7-b18b-4f79-81ce-144eeed5b162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a297ad7-b18b-4f79-81ce-144eeed5b162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c47315d8-74e5-493d-80d2-705b80cfd063', 'volume_name': 'volume-c47315d8-74e5-493d-80d2-705b80cfd063', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9580d59-bbc4-40cf-8d6a-d4ea103b6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9580d59-bbc4-40cf-8d6a-d4ea103b6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a9ca9f-267b-4e04-a942-e7087d310fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Volume c47315d8-74e5-493d-80d2-705b80cfd063: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c47315d8-74e5-493d-80d2-705b80cfd063', 'volume_size': 1} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-81995167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c47315d8-74e5-493d-80d2-705b80cfd063,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54fcd9c7a68d43c88f1a1931a3c043b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:10:53Z,use_quota=True,user_id='01f85b190a744bcfa967531e829b11b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7665b6ae-b923-4d19-a28c-e9a1eb5fd98c),volume_type_id=7665b6ae-b923-4d19-a28c-e9a1eb5fd98c)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Creating volume c47315d8-74e5-493d-80d2-705b80cfd063 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:10:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:10:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:53 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 1073741824 Sep 28 16:10:53 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 1073741824" returned: 0 in 0.737s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:54 devstack sudo[95498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 Sep 28 16:10:54 devstack sudo[95498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:54 devstack sudo[95498]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063" returned: 0 in 0.501s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:10:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66a9ca9f-267b-4e04-a942-e7087d310fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c47315d8-74e5-493d-80d2-705b80cfd063', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2485de1-f301-4b3c-9bbf-44f96f1ea179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:10:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Volume volume-c47315d8-74e5-493d-80d2-705b80cfd063 (c47315d8-74e5-493d-80d2-705b80cfd063): created successfully Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2485de1-f301-4b3c-9bbf-44f96f1ea179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Flow 'volume_create_manager' (01d12cf8-703f-4fb5-bca6-b4137b516ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:10:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bf1d6bf1-11ed-4ad4-b165-529213bb9fda tempest-VolumeTypesAccessTest-2041776602 None] Created volume successfully. Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Acquiring lock "cinder-c47315d8-74e5-493d-80d2-705b80cfd063-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "cinder-c47315d8-74e5-493d-80d2-705b80cfd063-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Acquiring lock "cinder-quobyte-c47315d8-74e5-493d-80d2-705b80cfd063" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:10:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "cinder-quobyte-c47315d8-74e5-493d-80d2-705b80cfd063" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:10:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a2801-5b68-49a6-a398-31b4e96f31ba]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 Sep 28 16:10:56 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:56 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:56 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063 Sep 28 16:10:56 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:57 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c47315d8-74e5-493d-80d2-705b80cfd063" returned: 0 in 0.745s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "cinder-quobyte-c47315d8-74e5-493d-80d2-705b80cfd063" released by "delete_volume" :: held 1.380s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:10:57 devstack cinder-volume[87150]: WARNING cinder.quota [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-129528705 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-129528705, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:57 devstack cinder-volume[87150]: WARNING cinder.quota [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-129528705 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-129528705, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Created reservations ['e0be2c0b-5c99-4b0e-8679-0ba85e999b05', 'c22d83b6-a65b-4314-82c7-a588421c28d6', '8fd0b459-c4b4-4d6e-9e01-1231cda3c9bf', '279bb7ce-84d8-42e1-8bdc-f9d5286eed3e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:10:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:10:57 devstack sudo[95571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:10:57 devstack sudo[95571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:10:58 devstack sudo[95571]: pam_unix(sudo:session): session closed for user root Sep 28 16:10:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:10:58 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:10:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Deleted volume successfully. Sep 28 16:10:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7fc1784d-6a94-4c04-9304-eb7ca8f522bf tempest-VolumeTypesAccessTest-2041776602 None] Lock "cinder-c47315d8-74e5-493d-80d2-705b80cfd063-delete_volume" released by "delete_volume" :: held 2.361s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:07 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=65,cinder:UPDATE=71,cinder:INSERT=13,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=64,cinder:UPDATE=77,cinder:DELETE=3,cinder:INSERT=18 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Flow 'volume_create_manager' (a26d205b-86f9-4c37-92ce-44c68b94a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4160b4-f67c-43c8-9207-f8d9452cd53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee4160b4-f67c-43c8-9207-f8d9452cd53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1342641770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a7ae94-1518-48c8-a554-e1f424f97fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00a711add74994ab3e07e9eb3ed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:14Z,use_quota=True,user_id='1f13c2f21106430d90d69870f0683527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9902e6df-0893-4eee-b68d-312214d1e634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9902e6df-0893-4eee-b68d-312214d1e634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba919286-c3b0-4159-88ac-345db66be02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba919286-c3b0-4159-88ac-345db66be02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99a7ae94-1518-48c8-a554-e1f424f97fdd', 'volume_name': 'volume-99a7ae94-1518-48c8-a554-e1f424f97fdd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2094f70-f04e-4d50-a2a7-424cfb65197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2094f70-f04e-4d50-a2a7-424cfb65197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b996da4-9da7-4096-8344-6d5ec3ec15d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Volume 99a7ae94-1518-48c8-a554-e1f424f97fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99a7ae94-1518-48c8-a554-e1f424f97fdd', 'volume_size': 1} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1342641770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99a7ae94-1518-48c8-a554-e1f424f97fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa00a711add74994ab3e07e9eb3ed90a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:14Z,use_quota=True,user_id='1f13c2f21106430d90d69870f0683527',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Creating volume 99a7ae94-1518-48c8-a554-e1f424f97fdd {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:14 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:11:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:14 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd 1073741824 Sep 28 16:11:14 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:15 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd 1073741824" returned: 0 in 0.682s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:15 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd Sep 28 16:11:15 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:16 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd" returned: 0 in 0.600s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.382s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b996da4-9da7-4096-8344-6d5ec3ec15d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99a7ae94-1518-48c8-a554-e1f424f97fdd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629c201-76e9-4340-80ae-c7a1a05feb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Volume volume-99a7ae94-1518-48c8-a554-e1f424f97fdd (99a7ae94-1518-48c8-a554-e1f424f97fdd): created successfully Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4629c201-76e9-4340-80ae-c7a1a05feb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Flow 'volume_create_manager' (a26d205b-86f9-4c37-92ce-44c68b94a880) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-13af197d-69d5-4dea-a5a1-2b5e04d9feaa tempest-VolumesServicesTestJSON-223831009 None] Created volume successfully. Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Acquiring lock "cinder-99a7ae94-1518-48c8-a554-e1f424f97fdd-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "cinder-99a7ae94-1518-48c8-a554-e1f424f97fdd-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Acquiring lock "cinder-quobyte-99a7ae94-1518-48c8-a554-e1f424f97fdd" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "cinder-quobyte-99a7ae94-1518-48c8-a554-e1f424f97fdd" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82499d-1e2a-4cf1-af46-45988e0cfcb5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack sudo[95691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd Sep 28 16:11:17 devstack sudo[95691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:17 devstack sudo[95691]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd" returned: 0 in 0.504s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:17 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd Sep 28 16:11:17 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:18 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-99a7ae94-1518-48c8-a554-e1f424f97fdd" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "cinder-quobyte-99a7ae94-1518-48c8-a554-e1f424f97fdd" released by "delete_volume" :: held 0.888s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Created reservations ['1651b1ca-6ce2-4041-9bfe-faa2711d6973', 'edd5264d-8ae6-4bef-a92d-a0f3781919a1', 'acb8a716-6a1c-4469-b940-cb3bbdfcb38d', '093e1536-8de7-4aa8-af81-4e1047edbf51'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:18 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:11:18 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:18 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Deleted volume successfully. Sep 28 16:11:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-57390d3f-dad1-457e-9c05-20f58fb67290 tempest-VolumesServicesTestJSON-223831009 None] Lock "cinder-99a7ae94-1518-48c8-a554-e1f424f97fdd-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Flow 'volume_create_manager' (b616a58e-41f7-4039-93ea-01cc59aec20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e13906-909d-4cd3-aefa-cc1d7b92b400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e13906-909d-4cd3-aefa-cc1d7b92b400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-779110039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae982957-99f7-4318-9697-c98bfd3e05cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dde55c86a564f3481a228a4b6db3d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:25Z,use_quota=True,user_id='40360b014da54af999b1a99631f695e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1328542-ae89-4eab-9fd1-560b81592b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1328542-ae89-4eab-9fd1-560b81592b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0de8ca-8726-4d16-90a5-0bb48894ab9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc0de8ca-8726-4d16-90a5-0bb48894ab9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae982957-99f7-4318-9697-c98bfd3e05cb', 'volume_name': 'volume-ae982957-99f7-4318-9697-c98bfd3e05cb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ff3ed6-858d-49a0-9fdf-c19bddbf164e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9ff3ed6-858d-49a0-9fdf-c19bddbf164e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087108d6-6324-4d96-9521-ab82757734db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Volume ae982957-99f7-4318-9697-c98bfd3e05cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae982957-99f7-4318-9697-c98bfd3e05cb', 'volume_size': 1} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-779110039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae982957-99f7-4318-9697-c98bfd3e05cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dde55c86a564f3481a228a4b6db3d17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:25Z,use_quota=True,user_id='40360b014da54af999b1a99631f695e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Creating volume ae982957-99f7-4318-9697-c98bfd3e05cb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:25 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb 1073741824 Sep 28 16:11:25 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:25 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb 1073741824" returned: 0 in 0.774s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:26 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb Sep 28 16:11:26 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:26 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087108d6-6324-4d96-9521-ab82757734db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae982957-99f7-4318-9697-c98bfd3e05cb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ff8898-8561-4b2c-bff0-9f32c675b357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Volume volume-ae982957-99f7-4318-9697-c98bfd3e05cb (ae982957-99f7-4318-9697-c98bfd3e05cb): created successfully Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91ff8898-8561-4b2c-bff0-9f32c675b357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Flow 'volume_create_manager' (b616a58e-41f7-4039-93ea-01cc59aec20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9b757b20-6bcb-4d80-aeaa-cd494481577a tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Created volume successfully. Sep 28 16:11:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Acquiring lock "cinder-ae982957-99f7-4318-9697-c98bfd3e05cb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "cinder-ae982957-99f7-4318-9697-c98bfd3e05cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Acquiring lock "cinder-quobyte-ae982957-99f7-4318-9697-c98bfd3e05cb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "cinder-quobyte-ae982957-99f7-4318-9697-c98bfd3e05cb" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b0dc9-78a6-4d55-a83b-71d9a6d17220]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:29 devstack sudo[95742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb Sep 28 16:11:29 devstack sudo[95742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:29 devstack sudo[95742]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb" returned: 0 in 0.747s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:29 devstack sudo[95747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb Sep 28 16:11:29 devstack sudo[95747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:30 devstack sudo[95747]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ae982957-99f7-4318-9697-c98bfd3e05cb" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "cinder-quobyte-ae982957-99f7-4318-9697-c98bfd3e05cb" released by "delete_volume" :: held 1.225s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Created reservations ['8186062f-969d-4120-8a9b-a1e426fd4e02', '534abca1-8992-4beb-8c45-77ed49f73a31', '0ccf6a50-c67c-4b74-9f3c-a45314418280', 'a4075e45-59a3-44fb-85a8-ddfd58d82342'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:30 devstack sudo[95750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:11:30 devstack sudo[95750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:30 devstack sudo[95750]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Deleted volume successfully. Sep 28 16:11:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-28834947-e73f-45f3-9e1a-6e433570f667 tempest-VolumeQuotasNegativeTestJSON-2018130805 None] Lock "cinder-ae982957-99f7-4318-9697-c98bfd3e05cb-delete_volume" released by "delete_volume" :: held 2.131s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:36 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:11:36 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:36 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:11:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:11:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=22,cinder:SELECT=15,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:41 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Flow 'volume_create_manager' (c314f0c0-c398-4523-aaf8-f50acd612bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18999b50-9d89-4225-950e-8ce83793679a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18999b50-9d89-4225-950e-8ce83793679a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-70732564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64db323a-eeca-49b5-85d2-4ae33a7a7960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e5eeae59094d1b819fc68924fd63bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:48Z,use_quota=True,user_id='50d077e6b697424490a9d856baf149cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ffaab4-8457-4281-ac33-112f196fe7e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ffaab4-8457-4281-ac33-112f196fe7e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f90278a-eb6b-4ee6-9a5d-e358b369c98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f90278a-eb6b-4ee6-9a5d-e358b369c98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64db323a-eeca-49b5-85d2-4ae33a7a7960', 'volume_name': 'volume-64db323a-eeca-49b5-85d2-4ae33a7a7960', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0a805-dc91-45f9-a019-8b4b309aca4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3df0a805-dc91-45f9-a019-8b4b309aca4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a9fe70-5179-4a93-b2ab-c2c3b79e779f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Volume 64db323a-eeca-49b5-85d2-4ae33a7a7960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64db323a-eeca-49b5-85d2-4ae33a7a7960', 'volume_size': 1} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-70732564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64db323a-eeca-49b5-85d2-4ae33a7a7960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7e5eeae59094d1b819fc68924fd63bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:48Z,use_quota=True,user_id='50d077e6b697424490a9d856baf149cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Creating volume 64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:47 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:11:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:48 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 1073741824 Sep 28 16:11:48 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:48 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 1073741824" returned: 0 in 0.885s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:48 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 Sep 28 16:11:48 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:49 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960" returned: 0 in 0.514s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a9fe70-5179-4a93-b2ab-c2c3b79e779f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64db323a-eeca-49b5-85d2-4ae33a7a7960', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c137e-56f2-4d1d-b0b7-af1e38fe5850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:49 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Volume volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 (64db323a-eeca-49b5-85d2-4ae33a7a7960): created successfully Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f43c137e-56f2-4d1d-b0b7-af1e38fe5850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Flow 'volume_create_manager' (c314f0c0-c398-4523-aaf8-f50acd612bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b0044ac7-fe83-459e-b5f4-09802beafe1f tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Created volume successfully. Sep 28 16:11:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Creating offline snapshot 4b74a37d-6c13-4bb3-b9e6-3c494685cc91 of volume 64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:11:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff5cd0-e304-43e3-ae01-37bc76fd19a5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:50 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 Sep 28 16:11:50 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:51 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960" returned: 0 in 0.615s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:51 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 1G Sep 28 16:11:51 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Flow 'volume_create_manager' (7110c85c-ce15-47d1-b9df-ee1c55e9fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f3eb4e-23ab-4fe8-86fc-c49280c8226e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f3eb4e-23ab-4fe8-86fc-c49280c8226e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-733498787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76304386-d12e-4133-bb06-9291f611bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553664f65f10440694db218b1136a879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:52Z,use_quota=True,user_id='455fe0f827c34b79a62510f1ffeeddf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84d58f3-e2e6-47d6-ad3f-da0eaa616300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b84d58f3-e2e6-47d6-ad3f-da0eaa616300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec114969-ab89-4ae7-b677-96529ea4cb57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:11:51 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 1G" returned: 0 in 0.856s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:51 devstack sudo[95801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 Sep 28 16:11:51 devstack sudo[95801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec114969-ab89-4ae7-b677-96529ea4cb57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '76304386-d12e-4133-bb06-9291f611bf71', 'volume_name': 'volume-76304386-d12e-4133-bb06-9291f611bf71', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e15bbe-9183-4730-af7d-e830d54b1fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e15bbe-9183-4730-af7d-e830d54b1fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec05196b-7371-401d-be24-92701da4582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:11:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Volume 76304386-d12e-4133-bb06-9291f611bf71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-76304386-d12e-4133-bb06-9291f611bf71', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:11:52 devstack sudo[95801]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Trying to clone 76304386-d12e-4133-bb06-9291f611bf71 from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:52 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 is being set with open permissions: ugo+rw Sep 28 16:11:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:52 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 Sep 28 16:11:52 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:52 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91" returned: 0 in 0.644s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:11:53 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info Sep 28 16:11:53 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de32b815-a980-427e-9cd6-6f38942dba4d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:53 devstack sudo[95819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD Sep 28 16:11:53 devstack sudo[95819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:53 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info is being set with open permissions: ugo+rw Sep 28 16:11:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:53 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info Sep 28 16:11:53 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:54 devstack sudo[95819]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD" returned: 0 in 0.835s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b is fetched for user 455fe0f827c34b79a62510f1ffeeddf9. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[881945c0-700f-4064-9fc9-9f04b8ce5e49]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:54 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.info" returned: 0 in 0.734s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.111s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:54 devstack sudo[95869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD Sep 28 16:11:54 devstack sudo[95869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-36e01ce6-94b1-4c8f-9e08-cca2f14ed587 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Create snapshot completed successfully Sep 28 16:11:55 devstack sudo[95869]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD" returned: 0 in 0.739s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-733498787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76304386-d12e-4133-bb06-9291f611bf71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='553664f65f10440694db218b1136a879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:11:52Z,use_quota=True,user_id='455fe0f827c34b79a62510f1ffeeddf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Creating volume 76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:11:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:55 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1073741824 Sep 28 16:11:55 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "cinder-4b74a37d-6c13-4bb3-b9e6-3c494685cc91-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-4b74a37d-6c13-4bb3-b9e6-3c494685cc91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "cinder-quobyte-4b74a37d-6c13-4bb3-b9e6-3c494685cc91" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:11:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-4b74a37d-6c13-4bb3-b9e6-3c494685cc91" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Deleting offline snapshot 4b74a37d-6c13-4bb3-b9e6-3c494685cc91 of volume 64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] snapshot_file for this snap is: volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcedfae-9179-4bf1-b560-5861409a8072]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:56 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1073741824" returned: 0 in 1.064s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:56 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 Sep 28 16:11:56 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:56 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 Sep 28 16:11:56 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:56 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91" returned: 0 in 0.658s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-64db323a-eeca-49b5-85d2-4ae33a7a7960(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a7f431-7dba-442b-85fb-c3f498217a6f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:56 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71" returned: 0 in 0.640s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:11:56 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Attempting download of 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume 76304386-d12e-4133-bb06-9291f611bf71. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:11:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9febe5be-bad4-40be-93cf-eefb5542d008]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:57 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 Sep 28 16:11:57 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:57 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1 Sep 28 16:11:57 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:57 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1" returned: 0 in 0.739s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:58 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960" returned: 0 in 1.197s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:58 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 Sep 28 16:11:58 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:58 devstack sudo[95971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1 Sep 28 16:11:58 devstack sudo[95971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:58 devstack sudo[95971]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1" returned: 1 in 0.714s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_d52r46u1' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[47526004-131a-4572-aa49-bd1db68acd71]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:58 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD Sep 28 16:11:58 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:58 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91" returned: 0 in 0.932s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:59 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91 Sep 28 16:11:59 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:59 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] 4199de88-fb3b-44ba-ad33-1430d8c72a6b was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:11:59 devstack sudo[95988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 Sep 28 16:11:59 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:11:59 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960.4b74a37d-6c13-4bb3-b9e6-3c494685cc91" returned: 0 in 0.812s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-4b74a37d-6c13-4bb3-b9e6-3c494685cc91" released by "_delete_snapshot" :: held 3.962s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:11:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" released by "delete_snapshot" :: held 4.058s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Created reservations ['59373919-a89c-4265-82e9-a721c1eaef61', '19d20b2a-fac7-427b-a217-7ea9d4105c1e', '4f8de4b4-9b7b-46ad-8a84-d1ba4af3d761', '16a672e8-05a0-48da-a303-d90485fd0e03'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Delete snapshot completed successfully. Sep 28 16:12:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b4012448-66d9-49ef-ac27-7123da5fdb6e tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-4b74a37d-6c13-4bb3-b9e6-3c494685cc91-delete_snapshot" released by "delete_snapshot" :: held 4.531s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "cinder-64db323a-eeca-49b5-85d2-4ae33a7a7960-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-64db323a-eeca-49b5-85d2-4ae33a7a7960-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbea96d-0762-4a83-943b-6afb6e62cc09]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:02 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 Sep 28 16:12:02 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:02 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960" returned: 0 in 0.776s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:02 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960 Sep 28 16:12:02 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:03 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71" returned: 0 in 3.812s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_e88qarxmdevstack@QuobyteHD, size 112.00 MB, duration 3.82 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:12:03 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Converted 112.00 MB image at 29.34 MB/s Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:03 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-64db323a-eeca-49b5-85d2-4ae33a7a7960" returned: 0 in 0.621s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:03 devstack sudo[96012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1G Sep 28 16:12:03 devstack sudo[96012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-quobyte-64db323a-eeca-49b5-85d2-4ae33a7a7960" released by "delete_volume" :: held 1.501s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Created reservations ['f359d6ae-9028-459d-b676-afbb694e1593', 'b07349b2-4684-4dd3-ade7-fbf11503a88a', '869aa695-de35-4f29-a48d-03b763d8afc8', '174d5592-fdb6-4be0-bd63-d7bc1511b277'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:03 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:03 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:03 devstack sudo[96012]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 1G" returned: 0 in 0.611s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Downloaded image 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume 76304386-d12e-4133-bb06-9291f611bf71 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b for user 455fe0f827c34b79a62510f1ffeeddf9 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Marking volume 76304386-d12e-4133-bb06-9291f611bf71 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Copying metadata from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b to 76304386-d12e-4133-bb06-9291f611bf71. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:12:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Creating volume glance metadata for volume 76304386-d12e-4133-bb06-9291f611bf71 backed by image 4199de88-fb3b-44ba-ad33-1430d8c72a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec05196b-7371-401d-be24-92701da4582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76304386-d12e-4133-bb06-9291f611bf71', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3769b4a5-8c52-4b74-9291-d46b1dab296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:04 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.569s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Deleted volume successfully. Sep 28 16:12:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Volume volume-76304386-d12e-4133-bb06-9291f611bf71 (76304386-d12e-4133-bb06-9291f611bf71): created successfully Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3769b4a5-8c52-4b74-9291-d46b1dab296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Flow 'volume_create_manager' (7110c85c-ce15-47d1-b9df-ee1c55e9fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bba5cd36-afab-4daa-8f7d-af11bf2b54e9 tempest-VolumesImageMetadata-2117711511 None] Created volume successfully. Sep 28 16:12:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e99f8204-0711-4686-aa30-91403e71a611 tempest-VolumeSnapshotQuotasNegativeTestJSON-348453700 None] Lock "cinder-64db323a-eeca-49b5-85d2-4ae33a7a7960-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Acquiring lock "cinder-76304386-d12e-4133-bb06-9291f611bf71-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "cinder-76304386-d12e-4133-bb06-9291f611bf71-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Acquiring lock "cinder-quobyte-76304386-d12e-4133-bb06-9291f611bf71" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "cinder-quobyte-76304386-d12e-4133-bb06-9291f611bf71" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[394f0448-2303-4322-9dfc-52bf7ca6fa2b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:05 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 Sep 28 16:12:05 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:06 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71" returned: 0 in 0.719s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:06 devstack sudo[96031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71 Sep 28 16:12:06 devstack sudo[96031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:06 devstack sudo[96031]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-76304386-d12e-4133-bb06-9291f611bf71" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "cinder-quobyte-76304386-d12e-4133-bb06-9291f611bf71" released by "delete_volume" :: held 1.357s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Created reservations ['976b5097-e6c6-4ef5-b57a-81170683f5cd', '9adc6376-8c20-4449-aca7-53d83782490c', 'a2345fb9-87d9-4474-87af-4e3f9171d853', '55ae24bc-7649-4827-9cf5-22c216c0a37c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:07 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:07 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:07 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.588s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Deleted volume successfully. Sep 28 16:12:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d2918d11-8e0e-4902-8ccd-779ed0919a0d tempest-VolumesImageMetadata-2117711511 None] Lock "cinder-76304386-d12e-4133-bb06-9291f611bf71-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=30,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=16 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Flow 'volume_create_manager' (27227785-e6ef-431a-859a-578e55781f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7f3102-c5c1-4965-afd4-494c28811002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb7f3102-c5c1-4965-afd4-494c28811002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1633714411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1339b62763d4b2f81c5aba7541856bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:18Z,use_quota=True,user_id='827e13dd43ff4b14b03f2810111bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eec22ea-0e91-4cd6-bff6-c55e14d0af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eec22ea-0e91-4cd6-bff6-c55e14d0af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211994bc-6a67-4711-8c05-f0df8093cf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (211994bc-6a67-4711-8c05-f0df8093cf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6', 'volume_name': 'volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657157f3-a409-4576-8ad4-1463b0ea7ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (657157f3-a409-4576-8ad4-1463b0ea7ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b08b43a-fa2c-4749-bd42-43a7b88d9168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Volume 0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6', 'volume_size': 1} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1633714411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1339b62763d4b2f81c5aba7541856bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:18Z,use_quota=True,user_id='827e13dd43ff4b14b03f2810111bea9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Creating volume 0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:18 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 1073741824 Sep 28 16:12:18 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (31fb83d8-8c63-4b86-8480-85518e705b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a21253-b7cc-4401-94e6-a96c9c1ef979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a21253-b7cc-4401-94e6-a96c9c1ef979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-32672178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee56e39-9013-46e6-b4ec-75ff257f3ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:19Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f655a-b98e-4d34-9af5-b83f86dce4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e40f655a-b98e-4d34-9af5-b83f86dce4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95451c3-b39b-4019-8f7a-0568b2d71dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c95451c3-b39b-4019-8f7a-0568b2d71dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee56e39-9013-46e6-b4ec-75ff257f3ea6', 'volume_name': 'volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e6065-6734-4423-9d20-2e4f5511b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f5e6065-6734-4423-9d20-2e4f5511b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c75bf26-d766-4118-a87d-3a98500e5116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:18 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Volume 8ee56e39-9013-46e6-b4ec-75ff257f3ea6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6', 'volume_size': 1} Sep 28 16:12:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:19 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 1073741824" returned: 0 in 1.135s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:19 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 Sep 28 16:12:19 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:19 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" returned: 0 in 0.552s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-32672178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee56e39-9013-46e6-b4ec-75ff257f3ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:19Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Creating volume 8ee56e39-9013-46e6-b4ec-75ff257f3ea6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b08b43a-fa2c-4749-bd42-43a7b88d9168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:19 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 1073741824 Sep 28 16:12:19 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faee81d-4047-4aec-93e0-ad2310850bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Volume volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 (0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6): created successfully Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faee81d-4047-4aec-93e0-ad2310850bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Flow 'volume_create_manager' (27227785-e6ef-431a-859a-578e55781f10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cc9760f7-c40b-41d6-b049-e05f1a684a61 tempest-AbsoluteLimitsTests-13201929 None] Created volume successfully. Sep 28 16:12:20 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 1073741824" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:20 devstack sudo[96187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 Sep 28 16:12:20 devstack sudo[96187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:20 devstack sudo[96187]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c75bf26-d766-4118-a87d-3a98500e5116) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56075e1-8bfe-4763-aed1-aedcdb72f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Volume volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 (8ee56e39-9013-46e6-b4ec-75ff257f3ea6): created successfully Sep 28 16:12:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c56075e1-8bfe-4763-aed1-aedcdb72f65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (31fb83d8-8c63-4b86-8480-85518e705b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-db88fb3c-60a0-469b-b1b2-ea054aa6c389 tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Acquiring lock "cinder-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "cinder-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Acquiring lock "cinder-quobyte-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "cinder-quobyte-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef3bac14-ec60-4640-a054-cae375be8350 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef3bac14-ec60-4640-a054-cae375be8350 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" acquired by "attach_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f59fb-c44d-4af8-b838-7bd1349d4788]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:22 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 Sep 28 16:12:22 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ef3bac14-ec60-4640-a054-cae375be8350 tempest-VolumesActionsTest-119918268 None] Attaching volume 8ee56e39-9013-46e6-b4ec-75ff257f3ea6 to instance 5887d1b5-78bf-493a-a9e0-6decd345e580 at mountpoint /dev/vdb on host None. Sep 28 16:12:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ef3bac14-ec60-4640-a054-cae375be8350 tempest-VolumesActionsTest-119918268 None] Attach volume completed successfully. Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef3bac14-ec60-4640-a054-cae375be8350 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" released by "attach_volume" :: held 0.332s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:22 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (6d46dd0e-acc4-424f-bed3-a4547a8613b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682308a-b54d-4737-8a98-fdeebaaf4bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" returned: 0 in 0.653s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d682308a-b54d-4737-8a98-fdeebaaf4bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-582735952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:23Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e1681d-3ad7-4c2f-9ed2-c0c6eadb80f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e1681d-3ad7-4c2f-9ed2-c0c6eadb80f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:23 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6 Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740df09c-eb41-4cd4-9660-97417b7a59ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:23 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (740df09c-eb41-4cd4-9660-97417b7a59ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d', 'volume_name': 'volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8837060e-6b2f-4d72-8281-5550602b961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8837060e-6b2f-4d72-8281-5550602b961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1487ee-fbd6-4058-a5f8-beb64194a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Volume ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d', 'volume_size': 1} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-582735952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:23Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Creating volume ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:23 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:23 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d 1073741824 Sep 28 16:12:23 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:23 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" returned: 0 in 0.729s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "cinder-quobyte-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6" released by "delete_volume" :: held 1.524s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Created reservations ['fc75acd1-b5f6-4c62-b284-3c182d3af0a0', 'f74c2b9d-ae44-4257-8088-7ada671bde10', '8b10c76c-2166-4dfb-a3ea-6f942b0b525d', '17803fde-c700-4403-9f3e-d28d50f19aac'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:24 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d 1073741824" returned: 0 in 1.059s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:24 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:24 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:24 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d Sep 28 16:12:24 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Terminate volume connection completed successfully. Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Detaching volume 8ee56e39-9013-46e6-b4ec-75ff257f3ea6 from instance 5887d1b5-78bf-493a-a9e0-6decd345e580. Sep 28 16:12:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Detach volume completed successfully. Sep 28 16:12:24 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:24 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c1cb6b69-6a29-4236-bb00-694eb95491f3 tempest-VolumesActionsTest-652280086 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" released by "detach_volume" :: held 0.322s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" returned: 0 in 0.662s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.827s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Deleted volume successfully. Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1487ee-fbd6-4058-a5f8-beb64194a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ded700-dbd3-47e5-92a9-4361b2e3ef5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Volume volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d (ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d): created successfully Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ded700-dbd3-47e5-92a9-4361b2e3ef5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (6d46dd0e-acc4-424f-bed3-a4547a8613b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b382984e-7627-44ac-9819-5c6c45b1addd tempest-AbsoluteLimitsTests-13201929 None] Lock "cinder-0605035f-fdd6-463e-bbc3-7e3bbc9dc9d6-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8260b5fb-dc9a-4825-b98a-f8ca906a7553 tempest-AttachVolumeTestJSON-598052386 None] Created volume successfully. Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-67175a7a-e9b8-4c07-8448-4565968fd972 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-67175a7a-e9b8-4c07-8448-4565968fd972 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-67175a7a-e9b8-4c07-8448-4565968fd972 tempest-VolumesActionsTest-119918268 None] Volume detach called, but volume not attached. Sep 28 16:12:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-67175a7a-e9b8-4c07-8448-4565968fd972 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-detach_volume" released by "detach_volume" :: held 0.067s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-quobyte-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "cinder-quobyte-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d6ede-a047-43c7-99cc-c4b82637aa0f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:26 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 Sep 28 16:12:26 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:27 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" returned: 0 in 0.809s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:27 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6 Sep 28 16:12:27 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:27 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" returned: 0 in 0.472s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "cinder-quobyte-8ee56e39-9013-46e6-b4ec-75ff257f3ea6" released by "delete_volume" :: held 1.390s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Created reservations ['765f80c9-0c81-4838-af4a-020630d05b87', '6723bd6d-1e50-4f50-9eee-f652713b3739', '879e77e9-113f-4765-9c24-2c3b8e2a4a25', 'b16b15b8-57ea-425e-ba56-fb58c83fac7f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:28 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:28 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:29 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.894s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Deleted volume successfully. Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-30a9ea99-d69b-4d5c-8374-57c57c8867aa req-4b469ddd-fe9c-4851-abff-40c8a3ee5e2d tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-30a9ea99-d69b-4d5c-8374-57c57c8867aa req-4b469ddd-fe9c-4851-abff-40c8a3ee5e2d tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2f7f59d7-c77c-4654-bab8-1ca99ca7cce1 tempest-VolumesActionsTest-119918268 None] Lock "cinder-8ee56e39-9013-46e6-b4ec-75ff257f3ea6-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-30a9ea99-d69b-4d5c-8374-57c57c8867aa req-4b469ddd-fe9c-4851-abff-40c8a3ee5e2d tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-30a9ea99-d69b-4d5c-8374-57c57c8867aa req-4b469ddd-fe9c-4851-abff-40c8a3ee5e2d tempest-AttachVolumeTestJSON-598052386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '600e0154-6da5-4b8a-83e9-e90e332fdb13', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-30a9ea99-d69b-4d5c-8374-57c57c8867aa req-4b469ddd-fe9c-4851-abff-40c8a3ee5e2d tempest-AttachVolumeTestJSON-598052386 None] attachment_update completed successfully. Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (a9715b4e-b966-4107-bca1-3e8e71a3c089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac9aef7-4d1e-4b65-bfe7-d1edb1312e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ac9aef7-4d1e-4b65-bfe7-d1edb1312e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1418979268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f4a82a-f0a3-4761-a2d3-0e39459a2beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:33Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bdb9ef-c9c7-4212-b345-07156861ff59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4bdb9ef-c9c7-4212-b345-07156861ff59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c256dd2-4955-4d23-b22a-a9978b27864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c256dd2-4955-4d23-b22a-a9978b27864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50f4a82a-f0a3-4761-a2d3-0e39459a2beb', 'volume_name': 'volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcaed8b-5b2b-40c4-8185-4bb0c3a77807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdcaed8b-5b2b-40c4-8185-4bb0c3a77807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af8cae1-feb4-42f0-ad40-606beaac0af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Volume 50f4a82a-f0a3-4761-a2d3-0e39459a2beb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb', 'volume_size': 1} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1418979268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50f4a82a-f0a3-4761-a2d3-0e39459a2beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b33d012471a740cda8d3141d38c3e83c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:33Z,use_quota=True,user_id='099f19309fd14686a506d9b9ef3ae796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Creating volume 50f4a82a-f0a3-4761-a2d3-0e39459a2beb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:33 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:33 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb 1073741824 Sep 28 16:12:33 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:33 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb 1073741824" returned: 0 in 0.830s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:34 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb Sep 28 16:12:34 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (94eb52a4-2a19-490e-9256-703d712c8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90a9f2-4f45-4df6-bfb1-0fd8bf7c03c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b90a9f2-4f45-4df6-bfb1-0fd8bf7c03c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930573093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8118639-4aac-4233-95e3-93efb0e2c380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:34Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c61a1d0-5b06-4fb8-ba63-3834535134c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c61a1d0-5b06-4fb8-ba63-3834535134c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5f5dd-978c-40a8-b6a6-f301a1fc5310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc5f5dd-978c-40a8-b6a6-f301a1fc5310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8118639-4aac-4233-95e3-93efb0e2c380', 'volume_name': 'volume-e8118639-4aac-4233-95e3-93efb0e2c380', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5544f7da-ba0a-4d70-af48-478159424729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5544f7da-ba0a-4d70-af48-478159424729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6d5a69-55f8-4c36-82ca-e71d18c07cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Volume e8118639-4aac-4233-95e3-93efb0e2c380: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8118639-4aac-4233-95e3-93efb0e2c380', 'volume_size': 1} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:34 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" returned: 0 in 0.464s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.223s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930573093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8118639-4aac-4233-95e3-93efb0e2c380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:34Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Creating volume e8118639-4aac-4233-95e3-93efb0e2c380 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3af8cae1-feb4-42f0-ad40-606beaac0af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 1073741824 Sep 28 16:12:34 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6238d31-11a0-411e-9e76-06e6b974b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Volume volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb (50f4a82a-f0a3-4761-a2d3-0e39459a2beb): created successfully Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6238d31-11a0-411e-9e76-06e6b974b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Flow 'volume_create_manager' (a9715b4e-b966-4107-bca1-3e8e71a3c089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4e33a0a6-238a-4b36-af39-63009526e79a tempest-AttachVolumeTestJSON-598052386 None] Created volume successfully. Sep 28 16:12:35 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 1073741824" returned: 0 in 0.898s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:35 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 Sep 28 16:12:35 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:35 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b6d5a69-55f8-4c36-82ca-e71d18c07cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8118639-4aac-4233-95e3-93efb0e2c380', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8082a803-3e08-4cf9-acf0-19ff98f005a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Volume volume-e8118639-4aac-4233-95e3-93efb0e2c380 (e8118639-4aac-4233-95e3-93efb0e2c380): created successfully Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8082a803-3e08-4cf9-acf0-19ff98f005a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (94eb52a4-2a19-490e-9256-703d712c8930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-184e180a-695d-4515-a060-06de2b20e888 tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-610dd099-d029-4b40-9f65-d1b056bf8900 req-f9706a37-934f-48c6-8ba2-4002ec4a8a18 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-610dd099-d029-4b40-9f65-d1b056bf8900 req-f9706a37-934f-48c6-8ba2-4002ec4a8a18 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:36 devstack sudo[96710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:36 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-610dd099-d029-4b40-9f65-d1b056bf8900 req-f9706a37-934f-48c6-8ba2-4002ec4a8a18 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-e8118639-4aac-4233-95e3-93efb0e2c380-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "cinder-e8118639-4aac-4233-95e3-93efb0e2c380-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-610dd099-d029-4b40-9f65-d1b056bf8900 req-f9706a37-934f-48c6-8ba2-4002ec4a8a18 tempest-AttachVolumeTestJSON-598052386 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3f0839bc-4335-4e96-a68c-2483dc33651a', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-quobyte-e8118639-4aac-4233-95e3-93efb0e2c380" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-e8118639-4aac-4233-95e3-93efb0e2c380" acquired by "delete_volume" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-610dd099-d029-4b40-9f65-d1b056bf8900 req-f9706a37-934f-48c6-8ba2-4002ec4a8a18 tempest-AttachVolumeTestJSON-598052386 None] attachment_update completed successfully. Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8c5347-c3f7-43c0-a38e-618a6cfc559e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:36 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.418s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:12:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:12:36 devstack sudo[96712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 Sep 28 16:12:36 devstack sudo[96712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:37 devstack sudo[96712]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380" returned: 0 in 0.538s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:37 devstack sudo[96723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380 Sep 28 16:12:37 devstack sudo[96723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:37 devstack sudo[96723]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e8118639-4aac-4233-95e3-93efb0e2c380" returned: 0 in 0.599s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-e8118639-4aac-4233-95e3-93efb0e2c380" released by "delete_volume" :: held 1.223s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Created reservations ['018774f2-e0c0-4f39-9841-5d19c3c5535a', '6b77a2dd-3d09-4213-9c89-b1d9b8c6f027', 'b74e858f-3bf9-4361-971e-2b12aee8059d', '1a770d76-e154-460c-a693-e66a97aa5b79'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:38 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:38 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:38 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.578s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Deleted volume successfully. Sep 28 16:12:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63e9ae52-4534-468d-ac75-9163768175ba tempest-VolumesActionsTest-652280086 None] Lock "cinder-e8118639-4aac-4233-95e3-93efb0e2c380-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Flow 'volume_create_manager' (5984928e-bc7f-49a8-9315-28a2b109c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf58e87-9eac-4e16-b932-e66001b50f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cf58e87-9eac-4e16-b932-e66001b50f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-652977885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733a9b38-07d1-4cb2-ae3a-392c280e51df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1631dbbcc63c40648f5b9ff7c1362463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:41Z,use_quota=True,user_id='f5614614bce94f9e85ea860cbe4a94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfdb07e-9734-4a64-ad7a-11fa7c9b2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdfdb07e-9734-4a64-ad7a-11fa7c9b2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b133ce-a679-4c74-9c60-d9c0ced8af7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35b133ce-a679-4c74-9c60-d9c0ced8af7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733a9b38-07d1-4cb2-ae3a-392c280e51df', 'volume_name': 'volume-733a9b38-07d1-4cb2-ae3a-392c280e51df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a98fd-8554-4256-9350-5c7f94ef8d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020a98fd-8554-4256-9350-5c7f94ef8d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c3d3a1-6260-4657-827e-4822730377b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Volume 733a9b38-07d1-4cb2-ae3a-392c280e51df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733a9b38-07d1-4cb2-ae3a-392c280e51df', 'volume_size': 1} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-652977885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733a9b38-07d1-4cb2-ae3a-392c280e51df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1631dbbcc63c40648f5b9ff7c1362463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:41Z,use_quota=True,user_id='f5614614bce94f9e85ea860cbe4a94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Creating volume 733a9b38-07d1-4cb2-ae3a-392c280e51df {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:40 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:41 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df 1073741824 Sep 28 16:12:41 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (ca83cf87-1ed5-4659-8589-87906919e0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cdc977-3661-4469-9a2b-17dcfdd51ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58cdc977-3661-4469-9a2b-17dcfdd51ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1020403676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4a9d4c-f2bd-406e-81b3-c6eac5aea064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:41Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad44873-ae41-4c4c-b2af-4d873e266c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad44873-ae41-4c4c-b2af-4d873e266c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aaf858-5988-4f2c-9b0f-b2c6438c40fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8aaf858-5988-4f2c-9b0f-b2c6438c40fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4a9d4c-f2bd-406e-81b3-c6eac5aea064', 'volume_name': 'volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ba773c-f169-491c-adc5-0a9b887bf1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4ba773c-f169-491c-adc5-0a9b887bf1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebe327-6673-4e4b-917e-906bb84af091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Volume 3a4a9d4c-f2bd-406e-81b3-c6eac5aea064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064', 'volume_size': 1} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-cb3c5592-5b90-4bd5-8ea2-739e34b4e8b2 req-561a3fda-909f-45b2-ad06-b2374642b12f tempest-AttachVolumeTestJSON-598052386 None] Terminate volume connection completed successfully. Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-cb3c5592-5b90-4bd5-8ea2-739e34b4e8b2 req-561a3fda-909f-45b2-ad06-b2374642b12f tempest-AttachVolumeTestJSON-598052386 None] Deleting attachment 600e0154-6da5-4b8a-83e9-e90e332fdb13. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:41 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df 1073741824" returned: 0 in 1.005s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=74,cinder:UPDATE=82,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:12:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:42 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df Sep 28 16:12:42 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:42 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df" returned: 0 in 0.536s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.356s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1020403676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4a9d4c-f2bd-406e-81b3-c6eac5aea064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:41Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Creating volume 3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:42 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c3d3a1-6260-4657-827e-4822730377b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733a9b38-07d1-4cb2-ae3a-392c280e51df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:42 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 1073741824 Sep 28 16:12:42 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfd4455-a074-4227-b256-6da5dedd1e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Volume volume-733a9b38-07d1-4cb2-ae3a-392c280e51df (733a9b38-07d1-4cb2-ae3a-392c280e51df): created successfully Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdfd4455-a074-4227-b256-6da5dedd1e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Flow 'volume_create_manager' (5984928e-bc7f-49a8-9315-28a2b109c844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3e350ae6-9a41-48f7-a0ec-83ec3e78dc41 tempest-VolumesTransfersV355Test-1536475994 None] Created volume successfully. Sep 28 16:12:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9330a537-45f0-40c2-83c1-2d763c857095 req-9cbba399-e4c7-4225-b2c8-5318a2ca6ae9 tempest-AttachVolumeTestJSON-598052386 None] Terminate volume connection completed successfully. Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9330a537-45f0-40c2-83c1-2d763c857095 req-9cbba399-e4c7-4225-b2c8-5318a2ca6ae9 tempest-AttachVolumeTestJSON-598052386 None] Deleting attachment 3f0839bc-4335-4e96-a68c-2483dc33651a. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:12:43 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 1073741824" returned: 0 in 0.745s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:43 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 Sep 28 16:12:43 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:43 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" returned: 0 in 0.404s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ebe327-6673-4e4b-917e-906bb84af091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe9e0c-f2ec-438f-a5cd-1190c3bc878d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Volume volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 (3a4a9d4c-f2bd-406e-81b3-c6eac5aea064): created successfully Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aebe9e0c-f2ec-438f-a5cd-1190c3bc878d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (ca83cf87-1ed5-4659-8589-87906919e0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4db91366-4aad-404e-af7d-8c55424f0711 tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "cinder-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-quobyte-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fda573-7188-4112-b932-5fde3aefb764]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:44 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 Sep 28 16:12:44 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" returned: 0 in 0.800s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:45 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064 Sep 28 16:12:45 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-44827869-e3f6-4c26-85d8-d9a88579934c tempest-VolumesTransfersV355Test-1633271876 None] Transfer volume completed successfully. Sep 28 16:12:46 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" returned: 0 in 0.729s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064" released by "delete_volume" :: held 1.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Created reservations ['4b76b091-0461-4ee9-bd43-0a0c5345946d', 'e7557a95-c7da-4519-9e5f-2cfca35d05a3', '6967a0d9-7aaa-4553-a457-ee3a41bf97f0', '2d2facc4-e3b8-4b55-aa05-f316e2c7bf3e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:46 devstack sudo[96819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:46 devstack sudo[96819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:47 devstack sudo[96819]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.439s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Deleted volume successfully. Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-26573538-3fc9-44a9-a081-598bb4715b88 tempest-VolumesActionsTest-652280086 None] Lock "cinder-3a4a9d4c-f2bd-406e-81b3-c6eac5aea064-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "cinder-733a9b38-07d1-4cb2-ae3a-392c280e51df-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-733a9b38-07d1-4cb2-ae3a-392c280e51df-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "cinder-quobyte-733a9b38-07d1-4cb2-ae3a-392c280e51df" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-quobyte-733a9b38-07d1-4cb2-ae3a-392c280e51df" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8765f548-b069-46c9-a0b7-66f4444ad7c9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:47 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df Sep 28 16:12:47 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (0e779ab6-9eae-4936-8216-54cba726788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fe19c-0d08-49d3-905a-60c3288b6ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1fe19c-0d08-49d3-905a-60c3288b6ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1252875358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62790a12-a3a8-468f-b3cb-e7fb5fd01718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:48Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bd686-30e7-458d-96c1-bb92c019e463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (380bd686-30e7-458d-96c1-bb92c019e463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6808b86-2783-4a67-bf6e-9d37582fa798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6808b86-2783-4a67-bf6e-9d37582fa798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62790a12-a3a8-468f-b3cb-e7fb5fd01718', 'volume_name': 'volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f28c67-bad8-433a-9f12-1b316a502ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71f28c67-bad8-433a-9f12-1b316a502ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967ce9b-5f63-4523-a5d3-a6429ce49f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Volume 62790a12-a3a8-468f-b3cb-e7fb5fd01718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718', 'volume_size': 1} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1252875358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62790a12-a3a8-468f-b3cb-e7fb5fd01718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:48Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Creating volume 62790a12-a3a8-468f-b3cb-e7fb5fd01718 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:48 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 1073741824 Sep 28 16:12:48 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df" returned: 0 in 0.681s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:48 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df Sep 28 16:12:48 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:48 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-733a9b38-07d1-4cb2-ae3a-392c280e51df" returned: 0 in 0.600s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-quobyte-733a9b38-07d1-4cb2-ae3a-392c280e51df" released by "delete_volume" :: held 1.379s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Created reservations ['48b545de-8e14-4bbb-9adf-b423a81aae70', '0909f852-598b-4bb4-b769-c528a9dda8d9', '32cd546a-2358-4ce7-8fbb-3c99d6b07cd6', '9830eea7-bf89-4642-8d42-b7e071810df0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:49 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 1073741824" returned: 0 in 0.938s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:49 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:49 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 Sep 28 16:12:49 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:49 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Deleted volume successfully. Sep 28 16:12:49 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718" returned: 0 in 0.565s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.650s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d430c74f-4ea9-4324-bf4a-d962b01e6e43 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-733a9b38-07d1-4cb2-ae3a-392c280e51df-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a967ce9b-5f63-4523-a5d3-a6429ce49f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078e4856-6ebf-41e8-a7e4-056217b7d922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:49 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Volume volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 (62790a12-a3a8-468f-b3cb-e7fb5fd01718): created successfully Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (078e4856-6ebf-41e8-a7e4-056217b7d922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:49 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (0e779ab6-9eae-4936-8216-54cba726788b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d7265f2-d643-415c-9b70-c4dd4cfd81cc tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-62790a12-a3a8-468f-b3cb-e7fb5fd01718-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "cinder-62790a12-a3a8-468f-b3cb-e7fb5fd01718-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-quobyte-62790a12-a3a8-468f-b3cb-e7fb5fd01718" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-62790a12-a3a8-468f-b3cb-e7fb5fd01718" acquired by "delete_volume" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d6aef3-9100-4322-8134-6b0b3cbc3654]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 Sep 28 16:12:51 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Flow 'volume_create_manager' (3a212e2b-5cfd-4f31-8696-47af79c3a506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1253fb09-da68-4e8c-a683-5991eee54eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1253fb09-da68-4e8c-a683-5991eee54eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1598416864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b81cc8-1ac8-4c94-99ac-43f05fdcadd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1631dbbcc63c40648f5b9ff7c1362463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:51Z,use_quota=True,user_id='f5614614bce94f9e85ea860cbe4a94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f233da0-fb06-4082-94be-1c159dd2ada6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f233da0-fb06-4082-94be-1c159dd2ada6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6119e8de-8a85-4e52-ab94-da5b7a88fbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6119e8de-8a85-4e52-ab94-da5b7a88fbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11b81cc8-1ac8-4c94-99ac-43f05fdcadd6', 'volume_name': 'volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5be1474-5eae-412c-b940-6982cccd0191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5be1474-5eae-412c-b940-6982cccd0191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae14e3ff-ffc9-46e6-91fd-40429050b180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Volume 11b81cc8-1ac8-4c94-99ac-43f05fdcadd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6', 'volume_size': 1} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1598416864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11b81cc8-1ac8-4c94-99ac-43f05fdcadd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1631dbbcc63c40648f5b9ff7c1362463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:51Z,use_quota=True,user_id='f5614614bce94f9e85ea860cbe4a94c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Creating volume 11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 1073741824 Sep 28 16:12:51 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:51 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718" returned: 0 in 0.855s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:51 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718 Sep 28 16:12:51 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:52 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-62790a12-a3a8-468f-b3cb-e7fb5fd01718" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-62790a12-a3a8-468f-b3cb-e7fb5fd01718" released by "delete_volume" :: held 1.361s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Created reservations ['c155fb3d-5198-4b9c-b799-71b5efb99348', '51fa2f9e-bdd6-4428-9bf3-0b1ee665beca', '74ddca88-b953-4e53-af0a-a247a80b92c5', '43e7227f-a917-44c2-a1b0-b3f4574d2c6e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:52 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:52 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:52 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 1073741824" returned: 0 in 1.040s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:52 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 Sep 28 16:12:52 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:52 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-50f4a82a-f0a3-4761-a2d3-0e39459a2beb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Deleted volume successfully. Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-50f4a82a-f0a3-4761-a2d3-0e39459a2beb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c558d626-b4e3-4eb2-976e-aefd3e816620 tempest-VolumesActionsTest-652280086 None] Lock "cinder-62790a12-a3a8-468f-b3cb-e7fb5fd01718-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-quobyte-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07abea39-af3a-4f72-952e-8b732063c3ba]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:52 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae14e3ff-ffc9-46e6-91fd-40429050b180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72abcc2a-d176-4d9a-90ed-591cb9237d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Volume volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 (11b81cc8-1ac8-4c94-99ac-43f05fdcadd6): created successfully Sep 28 16:12:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72abcc2a-d176-4d9a-90ed-591cb9237d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Flow 'volume_create_manager' (3a212e2b-5cfd-4f31-8696-47af79c3a506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b8df9982-58f8-4be4-a591-1151447cae74 tempest-VolumesTransfersV355Test-1536475994 None] Created volume successfully. Sep 28 16:12:53 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb Sep 28 16:12:53 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:53 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" returned: 0 in 0.545s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:53 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb Sep 28 16:12:53 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:53 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (0377f90f-e9a9-421b-b9e5-70c5f9c4af94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661a944d-cd6f-4a03-ac3d-0bf15a5b8659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" returned: 0 in 0.391s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (661a944d-cd6f-4a03-ac3d-0bf15a5b8659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778248116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcff40fe-c5ef-4cde-8967-1e7115bd4275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:54Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3864c6e-f50b-4ad3-a6c5-97c97173e254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3864c6e-f50b-4ad3-a6c5-97c97173e254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7dda8e-5d7d-40dc-ad4c-6f4d266e0482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d7dda8e-5d7d-40dc-ad4c-6f4d266e0482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcff40fe-c5ef-4cde-8967-1e7115bd4275', 'volume_name': 'volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f68d3ca-8a02-4bbe-b3f1-f5240d730cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f68d3ca-8a02-4bbe-b3f1-f5240d730cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33267ac2-0e27-42c2-9e96-9c947df6305a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Volume fcff40fe-c5ef-4cde-8967-1e7115bd4275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275', 'volume_size': 1} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1778248116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcff40fe-c5ef-4cde-8967-1e7115bd4275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:54Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Creating volume fcff40fe-c5ef-4cde-8967-1e7115bd4275 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-50f4a82a-f0a3-4761-a2d3-0e39459a2beb" released by "delete_volume" :: held 1.113s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:53 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 1073741824 Sep 28 16:12:53 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Flow 'volume_create_manager' (4325ebdd-5ae9-47dd-b4ce-e84d21c3d4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e80a57-b261-44fc-afaf-25391439daa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e80a57-b261-44fc-afaf-25391439daa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-946561581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0d7ce3-4812-4a9a-a824-4acc098bc034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2aad6f1c4d4a53b49e5d2204a9527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:54Z,use_quota=True,user_id='9250748a8c084151aec918c61a91a5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6924db04-48eb-4df7-b2ab-71e9dd487491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6924db04-48eb-4df7-b2ab-71e9dd487491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4263e75f-669f-4cd6-9e2c-860fe4c87cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4263e75f-669f-4cd6-9e2c-860fe4c87cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f0d7ce3-4812-4a9a-a824-4acc098bc034', 'volume_name': 'volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63473-5992-4c28-87e6-a95070081b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3db63473-5992-4c28-87e6-a95070081b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0989d23-f3b2-452d-b1f4-f3fe3ff3ee6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Volume 9f0d7ce3-4812-4a9a-a824-4acc098bc034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034', 'volume_size': 1} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "cinder-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Created reservations ['60e79448-a346-454b-90c6-424e7302df58', '4d678ade-66df-493d-b6c2-3892d6483a19', '5846d132-7e47-4fe7-bd57-dc2767a8f295', '63c7c842-9336-43ad-a0f2-06fcd837292f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "cinder-quobyte-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-quobyte-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc45e1b5-3b8e-49f9-9bd1-29c0912752f8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:54 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 Sep 28 16:12:54 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 1073741824" returned: 0 in 0.693s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:54 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Deleted volume successfully. Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d1890f0-4425-4908-bbe9-116baf4a6710 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-50f4a82a-f0a3-4761-a2d3-0e39459a2beb-delete_volume" released by "delete_volume" :: held 2.019s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:54 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:54 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" returned: 0 in 0.572s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:54 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6 Sep 28 16:12:54 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-quobyte-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:55 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.300s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-946561581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f0d7ce3-4812-4a9a-a824-4acc098bc034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e2aad6f1c4d4a53b49e5d2204a9527a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:54Z,use_quota=True,user_id='9250748a8c084151aec918c61a91a5ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Creating volume 9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:12:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5dfbbd-9838-4297-9d7d-696acca23995]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 1073741824 Sep 28 16:12:55 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33267ac2-0e27-42c2-9e96-9c947df6305a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c173ad-273a-48f1-afda-bf0c696f24c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:55 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" returned: 0 in 0.424s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Volume volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 (fcff40fe-c5ef-4cde-8967-1e7115bd4275): created successfully Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c173ad-273a-48f1-afda-bf0c696f24c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (0377f90f-e9a9-421b-b9e5-70c5f9c4af94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-quobyte-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6" released by "delete_volume" :: held 1.090s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9778d113-c2f8-4e98-9f72-a993c9d0142d tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:12:55 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d Sep 28 16:12:55 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Created reservations ['9b342fb0-4ba6-4d87-8cc5-f9442369f5e4', 'd5b8166f-70fb-4904-a993-e2531f9fd4d4', '8cdb4151-959b-4078-bb3f-d8cee5cc826f', 'f0b84a18-fdd1-4611-8758-319addafffff'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:55 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:55 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" returned: 0 in 0.523s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:55 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d Sep 28 16:12:55 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Deleted volume successfully. Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9698e28-3ee0-4b53-9963-69ce7e0717b5 tempest-VolumesTransfersV355Test-470525526 None] Lock "cinder-11b81cc8-1ac8-4c94-99ac-43f05fdcadd6-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:56 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 1073741824" returned: 0 in 0.800s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-fcff40fe-c5ef-4cde-8967-1e7115bd4275-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "cinder-fcff40fe-c5ef-4cde-8967-1e7115bd4275-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Acquiring lock "cinder-quobyte-fcff40fe-c5ef-4cde-8967-1e7115bd4275" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:56 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-fcff40fe-c5ef-4cde-8967-1e7115bd4275" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:56 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88445e39-404a-4f63-b238-1afc933caae0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d" released by "delete_volume" :: held 1.088s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Created reservations ['ecb2e3c3-0b96-4df3-880e-0b4fa21cf641', '4d8fc956-e8f2-42b8-8025-23916317491f', '4f4f40b6-de18-4778-aa72-cd1b0270e532', 'c357a47c-ea6d-42d3-932a-a391051bf104'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:56 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 Sep 28 16:12:56 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] <== create_volume: return (1279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:56 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0989d23-f3b2-452d-b1f4-f3fe3ff3ee6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0bb467-a527-4826-82d5-ba0f3077bac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Volume volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 (9f0d7ce3-4812-4a9a-a824-4acc098bc034): created successfully Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df0bb467-a527-4826-82d5-ba0f3077bac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Flow 'volume_create_manager' (4325ebdd-5ae9-47dd-b4ce-e84d21c3d4f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cafdafb2-74f8-40a3-b99d-c1b6c4662e62 tempest-SnapshotMetadataTestJSON-523631234 None] Created volume successfully. Sep 28 16:12:56 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275" returned: 0 in 0.521s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:56 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275 Sep 28 16:12:56 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:56 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Deleted volume successfully. Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-31980019-a0a5-4239-ad4b-31a9fc3eed88 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-ba4d529d-bfec-4bfd-9b1f-1f07bf1e541d-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:57 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fcff40fe-c5ef-4cde-8967-1e7115bd4275" returned: 0 in 0.503s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "cinder-quobyte-fcff40fe-c5ef-4cde-8967-1e7115bd4275" released by "delete_volume" :: held 1.106s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Created reservations ['d67d1e7c-a4ba-4af7-89be-c51dc5f43205', 'd4eb5eeb-bb75-4a41-8c9d-9270cae097cd', '7b0b37d3-fe44-4749-9852-c32d04f80504', '780fc131-3357-41f5-a5ff-12e32221d9fd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Creating offline snapshot d371907b-50ea-4fed-ae17-91b0f051da5d of volume 9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f681925-a1d6-4448-ae82-fea7cfe47e38]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:57 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:57 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-48116cfd-e86e-41f2-ad9d-2058693da863-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-48116cfd-e86e-41f2-ad9d-2058693da863-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:57 devstack sudo[96964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 Sep 28 16:12:57 devstack sudo[96964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "cinder-quobyte-48116cfd-e86e-41f2-ad9d-2058693da863" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:12:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-48116cfd-e86e-41f2-ad9d-2058693da863" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6020d7ad-6f4d-46ec-8a18-8f4605456120]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:12:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Deleted volume successfully. Sep 28 16:12:58 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 Sep 28 16:12:58 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a847f089-ee97-48ad-9139-8f05ac9ea667 tempest-VolumesActionsTest-652280086 None] Lock "cinder-fcff40fe-c5ef-4cde-8967-1e7115bd4275-delete_volume" released by "delete_volume" :: held 2.164s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:58 devstack sudo[96964]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034" returned: 0 in 0.707s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d 1G Sep 28 16:12:58 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:58 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863" returned: 0 in 0.824s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:58 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863 Sep 28 16:12:58 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d 1G" returned: 0 in 0.834s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d Sep 28 16:12:59 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-48116cfd-e86e-41f2-ad9d-2058693da863" returned: 0 in 0.503s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-quobyte-48116cfd-e86e-41f2-ad9d-2058693da863" released by "delete_volume" :: held 1.426s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (2eddfd49-78d1-4b98-8de2-bd809a7edd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5d18ce-72e3-486d-9f4a-a02623b07963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5d18ce-72e3-486d-9f4a-a02623b07963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161621832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133d122c-6643-4273-a5ed-92b9556fdfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:59Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14798b11-3d42-4db3-b983-3030f172857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14798b11-3d42-4db3-b983-3030f172857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6b3010-f044-4724-83d4-e288fa95c3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb6b3010-f044-4724-83d4-e288fa95c3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133d122c-6643-4273-a5ed-92b9556fdfd2', 'volume_name': 'volume-133d122c-6643-4273-a5ed-92b9556fdfd2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1c67aa-612f-4943-9ce5-d68ce49ef25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b1c67aa-612f-4943-9ce5-d68ce49ef25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb11554-044b-4426-b642-e929b9304bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:12:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Volume 133d122c-6643-4273-a5ed-92b9556fdfd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133d122c-6643-4273-a5ed-92b9556fdfd2', 'volume_size': 1} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Created reservations ['94f7bef4-a935-4ed2-992e-9f1fee51ec54', '496fac14-cb42-4a97-9b9c-99ef0e8f319f', '9a743764-6fb5-4a6a-9e8d-b6838c90cead', '44f8722a-3886-4e18-b6f7-b1b3261bb4a1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:12:59 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:12:59 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d is being set with open permissions: ugo+rw Sep 28 16:12:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:12:59 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:12:59 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:12:59 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d Sep 28 16:12:59 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:00 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Deleted volume successfully. Sep 28 16:13:00 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f70b1ba6-6931-49c8-a213-4b34b3fc95b9 tempest-AttachVolumeTestJSON-598052386 None] Lock "cinder-48116cfd-e86e-41f2-ad9d-2058693da863-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:00 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info Sep 28 16:13:00 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:00 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:00 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info is being set with open permissions: ugo+rw Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:00 devstack sudo[97003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info Sep 28 16:13:00 devstack sudo[97003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:00 devstack sudo[97003]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.info" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.354s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-161621832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133d122c-6643-4273-a5ed-92b9556fdfd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='39d541b005ae40de82aa659038097b9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:12:59Z,use_quota=True,user_id='d59e3371bda54588a27dc886e108d712',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Creating volume 133d122c-6643-4273-a5ed-92b9556fdfd2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:01 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 1073741824 Sep 28 16:13:01 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e535707a-cdbb-4ab3-a4ae-08aa0e25b874 tempest-SnapshotMetadataTestJSON-523631234 None] Create snapshot completed successfully Sep 28 16:13:01 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 1073741824" returned: 0 in 0.895s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:01 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 Sep 28 16:13:01 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:02 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb11554-044b-4426-b642-e929b9304bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133d122c-6643-4273-a5ed-92b9556fdfd2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad613ef8-34cf-43ac-a82d-a7287680ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Volume volume-133d122c-6643-4273-a5ed-92b9556fdfd2 (133d122c-6643-4273-a5ed-92b9556fdfd2): created successfully Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad613ef8-34cf-43ac-a82d-a7287680ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Flow 'volume_create_manager' (2eddfd49-78d1-4b98-8de2-bd809a7edd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-905e66aa-b799-4ec4-b0a1-3d685012f3a4 tempest-VolumesActionsTest-119918268 None] Created volume successfully. Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-133d122c-6643-4273-a5ed-92b9556fdfd2-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "cinder-133d122c-6643-4273-a5ed-92b9556fdfd2-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Acquiring lock "cinder-quobyte-133d122c-6643-4273-a5ed-92b9556fdfd2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "cinder-quobyte-133d122c-6643-4273-a5ed-92b9556fdfd2" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "cinder-d371907b-50ea-4fed-ae17-91b0f051da5d-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e616480f-27c0-404c-8f44-80ba11761916]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-d371907b-50ea-4fed-ae17-91b0f051da5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "cinder-quobyte-d371907b-50ea-4fed-ae17-91b0f051da5d" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-d371907b-50ea-4fed-ae17-91b0f051da5d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Deleting offline snapshot d371907b-50ea-4fed-ae17-91b0f051da5d of volume 9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] snapshot_file for this snap is: volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e41328-0dca-474f-a004-a86aa1e2f1e5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:04 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 Sep 28 16:13:04 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:04 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d Sep 28 16:13:04 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:04 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2" returned: 0 in 0.643s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:04 devstack sudo[97033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2 Sep 28 16:13:04 devstack sudo[97033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:04 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d" returned: 0 in 0.594s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6026654-485f-4dc5-9804-573cf6f64073]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:04 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 Sep 28 16:13:04 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:05 devstack sudo[97033]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-133d122c-6643-4273-a5ed-92b9556fdfd2" returned: 0 in 0.576s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "cinder-quobyte-133d122c-6643-4273-a5ed-92b9556fdfd2" released by "delete_volume" :: held 1.319s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Created reservations ['11564a7b-81ad-49ad-94b4-e9a660bdf38a', '669b7996-73df-4b36-a280-e55f77909d48', 'd50b0f8c-e548-42b3-8e67-4accaa019438', '4f4a73bb-3a7d-4bda-8574-406d00c33923'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:05 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034" returned: 0 in 0.611s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:05 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d Sep 28 16:13:05 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:05 devstack sudo[97044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:05 devstack sudo[97044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:05 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:05 devstack sudo[97044]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:05 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d Sep 28 16:13:05 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.458s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Deleted volume successfully. Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-22aacfa7-94a7-4903-818f-ae0a39824181 tempest-VolumesActionsTest-119918268 None] Lock "cinder-133d122c-6643-4273-a5ed-92b9556fdfd2-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:06 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034.d371907b-50ea-4fed-ae17-91b0f051da5d" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-d371907b-50ea-4fed-ae17-91b0f051da5d" released by "_delete_snapshot" :: held 2.416s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" released by "delete_snapshot" :: held 2.459s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Created reservations ['622d6cde-df3a-4ab4-9623-5434819871bc', '3d0901de-d755-420a-ad54-efc179d04e43', '9a38672b-626d-4cd7-b214-4d0517b4f90a', '825ca20e-eb14-4114-a6db-ce2b8d6c7cb5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Delete snapshot completed successfully. Sep 28 16:13:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cbee1512-0200-4cae-8fff-c740450aab25 tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-d371907b-50ea-4fed-ae17-91b0f051da5d-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "cinder-9f0d7ce3-4812-4a9a-a824-4acc098bc034-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-9f0d7ce3-4812-4a9a-a824-4acc098bc034-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe14c90b-3667-4919-bc34-d01c4b78e696]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:07 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 Sep 28 16:13:07 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:08 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034" returned: 0 in 0.855s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:08 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034 Sep 28 16:13:08 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Flow 'volume_create_manager' (99f80b3b-3013-481f-9bdd-c3ba84006834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db227df4-bb0b-4693-83c0-8eb3709f039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db227df4-bb0b-4693-83c0-8eb3709f039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-809541364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38327973648d42eebafe903326094fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:08Z,use_quota=True,user_id='0117a0bc88de4d85ac423a5a6e05fef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a644876a-70ea-4967-bb66-794e32b7e3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a644876a-70ea-4967-bb66-794e32b7e3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362a7591-7324-4e75-84ef-efd1be2cd8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:08 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:13:09 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9f0d7ce3-4812-4a9a-a824-4acc098bc034" returned: 0 in 0.647s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-quobyte-9f0d7ce3-4812-4a9a-a824-4acc098bc034" released by "delete_volume" :: held 1.661s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Created reservations ['d1574e75-0784-493c-894d-6698da32ef5c', '3288705a-fe27-4758-8744-329624083ad1', 'ba526d92-8238-43fc-b99c-f8edceb3e13c', '884064ff-c09d-4b1a-9b81-4f2c2e6ea2e8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:09 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:09 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (362a7591-7324-4e75-84ef-efd1be2cd8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c', 'volume_name': 'volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dadead-1bee-4b02-8451-4357843eac01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84dadead-1bee-4b02-8451-4357843eac01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5442a-3f7c-487f-9d0a-1fbaee208603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Trying to clone a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:13:09 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.489s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:09 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Deleted volume successfully. Sep 28 16:13:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6652aefa-0ac9-4c22-a009-05826d80f40c tempest-SnapshotMetadataTestJSON-523631234 None] Lock "cinder-9f0d7ce3-4812-4a9a-a824-4acc098bc034-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:10 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:13:10 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:13:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb4e034-c5e9-4a74-ae08-efaff8d503f8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:10 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD Sep 28 16:13:10 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:11 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD" returned: 0 in 0.596s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b is fetched for user 0117a0bc88de4d85ac423a5a6e05fef8. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[daddd853-8bca-4c90-a810-e82f47e92ac1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:11 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD Sep 28 16:13:11 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:11 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-809541364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38327973648d42eebafe903326094fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:08Z,use_quota=True,user_id='0117a0bc88de4d85ac423a5a6e05fef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Creating volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:12 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1073741824 Sep 28 16:13:12 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:12 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1073741824" returned: 0 in 0.956s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:13 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c Sep 28 16:13:13 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:13 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] <== create_volume: return (1420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Attempting download of 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51cfdd0-fb04-4e54-a515-f25e72e769fc]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:13 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322 Sep 28 16:13:13 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:13 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322 Sep 28 16:13:14 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:14 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322" returned: 1 in 0.574s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_p2s3a322' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:13:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98b0624-6917-47a3-916c-26f754568358]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:14 devstack sudo[97100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD Sep 28 16:13:14 devstack sudo[97100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:15 devstack sudo[97100]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD" returned: 0 in 0.738s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:15 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] 4199de88-fb3b-44ba-ad33-1430d8c72a6b was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:13:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:15 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c Sep 28 16:13:15 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-45baa5f2-d899-4185-bb48-94c4c4716cda tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-1021927836: creating Sep 28 16:13:17 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=133,cinder:UPDATE=157,cinder:DELETE=13,cinder:INSERT=35 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-45baa5f2-d899-4185-bb48-94c4c4716cda tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-1021927836: created successfully Sep 28 16:13:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-45baa5f2-d899-4185-bb48-94c4c4716cda tempest-GroupSnapshotsTest-1152799999 None] Create group completed successfully. Sep 28 16:13:18 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" returned: 0 in 3.229s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:18 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_tsrofb39devstack@QuobyteHD, size 112.00 MB, duration 3.23 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:13:18 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Converted 112.00 MB image at 34.67 MB/s Sep 28 16:13:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:18 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1G Sep 28 16:13:18 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:19 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 1G" returned: 0 in 0.553s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Downloaded image 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b for user 0117a0bc88de4d85ac423a5a6e05fef8 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Marking volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Copying metadata from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b to a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Creating volume glance metadata for volume a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c backed by image 4199de88-fb3b-44ba-ad33-1430d8c72a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d5442a-3f7c-487f-9d0a-1fbaee208603) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc90c81-a314-4575-864c-c857df707ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Volume volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c (a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c): created successfully Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc90c81-a314-4575-864c-c857df707ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Flow 'volume_create_manager' (99f80b3b-3013-481f-9bdd-c3ba84006834) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bb14013-61e7-46f4-a38b-cd523bbcc9b7 tempest-VolumesExtendTest-807967192 None] Created volume successfully. Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (6442971d-2806-4271-b065-b9b080293287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1551ce5a-1011-4579-a8b1-6c73186e328a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1551ce5a-1011-4579-a8b1-6c73186e328a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307198434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d4a574c-3872-4fb6-bec6-d7b277616e98,host='devstack@QuobyteHD#QuobyteHD',id=4ac24e37-843f-4b05-81ec-928c3129772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:19Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0f00af2-43be-4fef-985a-2e8e0f8fc222),volume_type_id=e0f00af2-43be-4fef-985a-2e8e0f8fc222)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e18c4-c7b4-4158-9849-f8d99aed5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b85e18c4-c7b4-4158-9849-f8d99aed5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dca12f-b5e7-4505-81bd-16515704266b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44dca12f-b5e7-4505-81bd-16515704266b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ac24e37-843f-4b05-81ec-928c3129772c', 'volume_name': 'volume-4ac24e37-843f-4b05-81ec-928c3129772c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f453518-9e48-41cf-8149-6b94870f7c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f453518-9e48-41cf-8149-6b94870f7c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41a71c6-ac91-41d5-86d0-ed139fd64221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Volume 4ac24e37-843f-4b05-81ec-928c3129772c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ac24e37-843f-4b05-81ec-928c3129772c', 'volume_size': 1} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4d4a574c-3872-4fb6-bec6-d7b277616e98,created_at=2026-09-28T14:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307198434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4d4a574c-3872-4fb6-bec6-d7b277616e98,host='devstack@QuobyteHD#QuobyteHD',id=4ac24e37-843f-4b05-81ec-928c3129772c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:19Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0f00af2-43be-4fef-985a-2e8e0f8fc222),volume_type_id=e0f00af2-43be-4fef-985a-2e8e0f8fc222)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Creating volume 4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:19 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c 1073741824 Sep 28 16:13:19 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:20 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c 1073741824" returned: 0 in 0.753s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:20 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:20 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:21 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.285s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.998s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41a71c6-ac91-41d5-86d0-ed139fd64221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ac24e37-843f-4b05-81ec-928c3129772c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece9a032-9421-4b8e-a623-a8559445f437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b455e2-fd1c-41d4-9070-bda2fc3ff151]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Volume volume-4ac24e37-843f-4b05-81ec-928c3129772c (4ac24e37-843f-4b05-81ec-928c3129772c): created successfully Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece9a032-9421-4b8e-a623-a8559445f437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (6442971d-2806-4271-b065-b9b080293287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7ea52f45-b52f-48be-b508-78977afc2849 tempest-GroupSnapshotsTest-1152799999 None] Created volume successfully. Sep 28 16:13:21 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c Sep 28 16:13:21 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:21 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" returned: 0 in 0.622s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c 2G" returned: 0 in 0.195s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.861s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cf2c43a1-ea63-4ea1-90ba-1c05b22d5e1a tempest-VolumesExtendTest-807967192 None] Extend volume completed successfully. Sep 28 16:13:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] GroupSnapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: creating. Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Group snapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Creating offline snapshot 07d0c125-ee3b-4080-b759-3aac3a5ea270 of volume 4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0145a0-9f57-4f22-a67e-7f37e9c52ecb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:22 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:22 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "cinder-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:23 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.803s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:23 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 1G Sep 28 16:13:23 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-quobyte-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" acquired by "delete_volume" :: waited 0.050s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49826909-1a74-402e-ae43-2983c387c83d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:23 devstack sudo[97149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c Sep 28 16:13:23 devstack sudo[97149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (4555c6bb-a77e-4da9-80a6-aa64436d421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbccd5e-2cee-4b14-81d4-174edf2e6529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbccd5e-2cee-4b14-81d4-174edf2e6529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1306164675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc057d7-dc90-44ba-93ab-2333403baf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e1266e98d44f2e9f40ee004d3c6f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:24Z,use_quota=True,user_id='4f372162422144a8b2c9ab8a40f74406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d612d88-c302-48f0-adbc-46b1b8454d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d612d88-c302-48f0-adbc-46b1b8454d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3cba7-ff6a-45c6-b520-daf9ee25892a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9b3cba7-ff6a-45c6-b520-daf9ee25892a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc057d7-dc90-44ba-93ab-2333403baf8a', 'volume_name': 'volume-1fc057d7-dc90-44ba-93ab-2333403baf8a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4be3f46-aed4-4855-8fa3-502b5d242e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4be3f46-aed4-4855-8fa3-502b5d242e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005b3d3-f210-4666-8279-e704e3a838f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Volume 1fc057d7-dc90-44ba-93ab-2333403baf8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc057d7-dc90-44ba-93ab-2333403baf8a', 'volume_size': 1} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:24 devstack sudo[97149]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" returned: 0 in 0.732s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:24 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:24 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c Sep 28 16:13:24 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 1G" returned: 0 in 0.968s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac24e37-843f-4b05-81ec-928c3129772c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:24 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac24e37-843f-4b05-81ec-928c3129772c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:24 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:24 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c" released by "delete_volume" :: held 1.258s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:24 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ac24e37-843f-4b05-81ec-928c3129772c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:13:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:25 devstack sudo[97168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:25 devstack sudo[97168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Created reservations ['70a6c88c-1da6-4149-97b3-697831da7926', '17f0018c-7a65-4fa8-94f1-fc04340dc185', '2933c0d7-2a3a-4b99-88a2-5f5d57ffa1fa', 'ac68a05e-0bbe-4fbb-ba09-db1f77121c23'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:25 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:25 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:25 devstack sudo[97168]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:25 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info Sep 28 16:13:25 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:25 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Deleted volume successfully. Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bb2c4a7-e044-4cc3-94d8-4229934de4b1 tempest-VolumesExtendTest-807967192 None] Lock "cinder-a18da5b2-9bac-4c97-86e1-1bc4b2b88b5c-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:25 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:25 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:13:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:25 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info Sep 28 16:13:25 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:26 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.info" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.727s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.974s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1306164675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc057d7-dc90-44ba-93ab-2333403baf8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e1266e98d44f2e9f40ee004d3c6f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:24Z,use_quota=True,user_id='4f372162422144a8b2c9ab8a40f74406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Creating volume 1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:26 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a 1073741824 Sep 28 16:13:26 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8ac09543-12df-410f-9fdf-92b02d799de8 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: created successfully Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Flow 'volume_create_manager' (0f63121d-4803-4aaa-8f92-81e66451fd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f03bbcd-1f66-46f9-87b9-fa9eb3bb24f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f03bbcd-1f66-46f9-87b9-fa9eb3bb24f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1830786060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f500101b-d79a-4046-bb10-d4d2e53f0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38327973648d42eebafe903326094fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:27Z,use_quota=True,user_id='0117a0bc88de4d85ac423a5a6e05fef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5364d0-62dc-4025-9a19-15b7538bca9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db5364d0-62dc-4025-9a19-15b7538bca9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40739e5f-71bf-48ee-a5ba-1ec910105592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40739e5f-71bf-48ee-a5ba-1ec910105592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f500101b-d79a-4046-bb10-d4d2e53f0620', 'volume_name': 'volume-f500101b-d79a-4046-bb10-d4d2e53f0620', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16cffdd-43b3-4f5f-99bc-09eb4f4ec9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16cffdd-43b3-4f5f-99bc-09eb4f4ec9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a444d3d-ab36-46d6-ae0c-68b1d6ec30de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Volume f500101b-d79a-4046-bb10-d4d2e53f0620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f500101b-d79a-4046-bb10-d4d2e53f0620', 'volume_size': 1} Sep 28 16:13:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:27 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a 1073741824" returned: 0 in 0.833s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:27 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:27 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:27 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.647s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1830786060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f500101b-d79a-4046-bb10-d4d2e53f0620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38327973648d42eebafe903326094fcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:27Z,use_quota=True,user_id='0117a0bc88de4d85ac423a5a6e05fef8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Creating volume f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:27 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8005b3d3-f210-4666-8279-e704e3a838f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc057d7-dc90-44ba-93ab-2333403baf8a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:27 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 1073741824 Sep 28 16:13:27 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7408b2-69de-403e-b234-c2aa79a62b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Volume volume-1fc057d7-dc90-44ba-93ab-2333403baf8a (1fc057d7-dc90-44ba-93ab-2333403baf8a): created successfully Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d7408b2-69de-403e-b234-c2aa79a62b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (4555c6bb-a77e-4da9-80a6-aa64436d421c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d7dd1fb-bf38-4f89-914a-bcf47d2a0ef3 tempest-VolumesDeleteCascade-891977393 None] Created volume successfully. Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:28 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 1073741824" returned: 0 in 0.814s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:28 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:28 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:28 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.890s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270-61804571-d6b6-4f76-80e3-047191eae7da" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a444d3d-ab36-46d6-ae0c-68b1d6ec30de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f500101b-d79a-4046-bb10-d4d2e53f0620', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9fc071-4e78-41a2-af3c-736d9c3a20f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270-61804571-d6b6-4f76-80e3-047191eae7da" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Creating volume 61804571-d6b6-4f76-80e3-047191eae7da from snapshot 07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Volume volume-f500101b-d79a-4046-bb10-d4d2e53f0620 (f500101b-d79a-4046-bb10-d4d2e53f0620): created successfully Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9fc071-4e78-41a2-af3c-736d9c3a20f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Flow 'volume_create_manager' (0f63121d-4803-4aaa-8f92-81e66451fd82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" acquired by "_copy_volume_from_snapshot" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] snapshot: 07d0c125-ee3b-4080-b759-3aac3a5ea270, volume: 61804571-d6b6-4f76-80e3-047191eae7da, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:13:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b9659c03-72bd-4c71-830a-2fa3f5f1de41 tempest-VolumesExtendTest-807967192 None] Created volume successfully. Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931af45-ee03-43d5-8d10-a363ab0f3278]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:29 devstack sudo[97199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:29 devstack sudo[97199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:29 devstack sudo[97199]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.521s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ac24e37-843f-4b05-81ec-928c3129772c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a072bbc-b9f1-496e-a8e4-a2c5b31e40d2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:29 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:29 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:30 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:30 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da Sep 28 16:13:30 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Flow 'volume_create_manager' (5c741a16-0832-423b-9374-8e9a9047353d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6529d5fd-133c-4670-8eea-a8d4ab0dd88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6529d5fd-133c-4670-8eea-a8d4ab0dd88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1157328681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c922586-37fd-49b3-b5be-caa53cb722b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f9227bea94b2ca484176ff1ac3485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:31Z,use_quota=True,user_id='33f4a214adb14f0e86b33c0bbd2efc8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24008e3-c06c-4de2-8f2c-83efb3f12578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c24008e3-c06c-4de2-8f2c-83efb3f12578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba170c4c-9170-48d3-8bfb-adcbaef8819c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba170c4c-9170-48d3-8bfb-adcbaef8819c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c922586-37fd-49b3-b5be-caa53cb722b6', 'volume_name': 'volume-9c922586-37fd-49b3-b5be-caa53cb722b6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfd85c5-b1fa-4e00-80cc-4a5ca7a3400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cfd85c5-b1fa-4e00-80cc-4a5ca7a3400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdc4879-7fdb-46ea-bffa-cb53006e3345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Volume 9c922586-37fd-49b3-b5be-caa53cb722b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c922586-37fd-49b3-b5be-caa53cb722b6', 'volume_size': 1} Sep 28 16:13:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:36 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:36 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:36 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:13:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:13:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:13:38 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da" returned: 0 in 8.103s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c, size 1024.00 MB, duration 8.10 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:13:38 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Converted 1024.00 MB image at 126.36 MB/s Sep 28 16:13:38 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:38 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da Sep 28 16:13:38 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:38 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da" returned: 0 in 0.258s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" released by "_copy_volume_from_snapshot" :: held 9.587s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270-61804571-d6b6-4f76-80e3-047191eae7da" released by "_create_volume_from_snapshot" :: held 9.696s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.750s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.786s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Creating offline snapshot 226239da-b218-49c6-bedb-24de1e136a6d of volume 1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21234b79-b8ef-46cc-883e-38d53f5f99d9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b5929f08-bcfd-4266-82a0-94136f82f903 tempest-GroupSnapshotsTest-1152799999 None] Create group from source-snapshot-5309c5d1-a4cd-4fdc-9954-fb13a69faf6f completed successfully. Sep 28 16:13:38 devstack sudo[97230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:38 devstack sudo[97230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:39 devstack sudo[97230]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:39 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d 1G Sep 28 16:13:39 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:39 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d 1G" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c76b59-f6e3-47e3-9a64-4e6849d14f69]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:39 devstack sudo[97241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:39 devstack sudo[97241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:39 devstack sudo[97242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da Sep 28 16:13:39 devstack sudo[97242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[97241]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d is being set with open permissions: ugo+rw Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:40 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[97242]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da Sep 28 16:13:40 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info Sep 28 16:13:40 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-61804571-d6b6-4f76-80e3-047191eae7da" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61804571-d6b6-4f76-80e3-047191eae7da" released by "delete_volume" :: held 0.842s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['1353d941-032d-4bee-a797-e3d581285ddb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:40 devstack cinder-volume[87150]: WARNING cinder.quota [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2142665511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2142665511, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:40 devstack cinder-volume[87150]: WARNING cinder.quota [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2142665511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2142665511, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['46123a30-192c-46c7-b79c-9253ed4a6431', '57d5a8bb-cc63-41f2-9eda-765607a2c18d', '84d343f6-474c-492e-aa9e-27ca7d1c2430', '134b6600-06a7-4a82-ac98-2bbd0ce4f206'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:40 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:40 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info is being set with open permissions: ugo+rw Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info Sep 28 16:13:40 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:40 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:40 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:41 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: deleting Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.info" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:41 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.419s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.572s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-da4576be-119a-4f73-9873-3f32aa6f2d8d tempest-GroupSnapshotsTest-1152799999 None] Delete group completed successfully. Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:13:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-481d98a2-bf8d-4812-9787-9d448f1fa1da tempest-VolumesDeleteCascade-891977393 None] Create snapshot completed successfully Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Creating offline snapshot ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 of volume f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c25e6a-f047-45e1-8d60-9cccf2ec8040]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Deleting offline snapshot 07d0c125-ee3b-4080-b759-3aac3a5ea270 of volume 4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] snapshot_file for this snap is: volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378ac17-88db-453c-8404-5166bd487ac7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:41 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:41 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:41 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:41 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:41 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.415s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:41 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 1G Sep 28 16:13:41 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:41 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.476s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ac24e37-843f-4b05-81ec-928c3129772c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1989864f-6bf3-4207-93a9-913227fd5c77]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:42 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=148,cinder:DELETE=11,cinder:SELECT=121,cinder:INSERT=39 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:42 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 1G" returned: 0 in 0.600s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f500101b-d79a-4046-bb10-d4d2e53f0620 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f500101b-d79a-4046-bb10-d4d2e53f0620 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 Sep 28 16:13:42 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.712s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f500101b-d79a-4046-bb10-d4d2e53f0620 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:42 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 is being set with open permissions: ugo+rw Sep 28 16:13:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:42 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:42 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:42 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 Sep 28 16:13:42 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" returned: 0 in 0.301s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info Sep 28 16:13:43 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270 Sep 28 16:13:43 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info" returned: 0 in 0.326s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info is being set with open permissions: ugo+rw Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c.07d0c125-ee3b-4080-b759-3aac3a5ea270" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info Sep 28 16:13:43 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-07d0c125-ee3b-4080-b759-3aac3a5ea270" released by "_delete_snapshot" :: held 2.052s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" released by "delete_snapshot" :: held 2.093s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:43 devstack cinder-volume[87150]: WARNING cinder.quota [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2142665511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2142665511, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['b1299840-0004-4f6f-88c7-635d9be6309c', '255a1dd4-556f-411a-b57d-01fc0ee81c07', '971da632-3f5d-48dd-889b-84ab45d7a5de', 'c8fb7535-c6f1-4674-8da5-c3ecea00c6bb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d6c4a5e1-9329-42fe-8106-2cf0c1e76187 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 5309c5d1-a4cd-4fdc-9954-fb13a69faf6f: deleted successfully Sep 28 16:13:43 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.info" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.595s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.374s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1157328681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c922586-37fd-49b3-b5be-caa53cb722b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113f9227bea94b2ca484176ff1ac3485',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:31Z,use_quota=True,user_id='33f4a214adb14f0e86b33c0bbd2efc8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Creating volume 9c922586-37fd-49b3-b5be-caa53cb722b6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:43 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 1073741824 Sep 28 16:13:43 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c6d0c055-043e-4a75-b95e-fcd9c26385d6 tempest-VolumesExtendTest-807967192 None] Create snapshot completed successfully Sep 28 16:13:44 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 1073741824" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:44 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 Sep 28 16:13:44 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:44 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.395s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcdc4879-7fdb-46ea-bffa-cb53006e3345) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c922586-37fd-49b3-b5be-caa53cb722b6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50228da1-b35b-4147-9222-53bd44663730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Creating offline snapshot e3b72960-73a0-4f20-89fa-bec993e7ff2b of volume 1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:13:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Volume volume-9c922586-37fd-49b3-b5be-caa53cb722b6 (9c922586-37fd-49b3-b5be-caa53cb722b6): created successfully Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50228da1-b35b-4147-9222-53bd44663730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Flow 'volume_create_manager' (5c741a16-0832-423b-9374-8e9a9047353d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14f8635-ad5a-4b6b-abbb-fff4a382ec75]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5211b0e4-42de-4351-abac-d14ed2e5ff2c tempest-VolumesMetadataTest-1389381831 None] Created volume successfully. Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:44 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:44 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2484a12c-d0b4-41d4-b5a8-807b357e1772]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:45 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:45 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:45 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.465s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc057d7-dc90-44ba-93ab-2333403baf8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:45 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b 1G Sep 28 16:13:45 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:45 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:45 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c Sep 28 16:13:45 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:45 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ac24e37-843f-4b05-81ec-928c3129772c" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4ac24e37-843f-4b05-81ec-928c3129772c" released by "delete_volume" :: held 0.992s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['e049b5ba-df85-4d05-abb0-25f9fe5eef81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:46 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b 1G" returned: 0 in 0.724s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:46 devstack sudo[97336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:46 devstack sudo[97336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:46 devstack cinder-volume[87150]: WARNING cinder.db.api [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2142665511'] Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['4a32e096-bef7-4942-8ac7-70ecab2e2cf6', 'fc4e2cfd-47d2-4f2b-a196-97b320b03333', '48f9fca8-d078-454b-a288-2287589fb014', '72614a30-adea-4101-8349-af1154307353'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:46 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:46 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:46 devstack sudo[97336]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b is being set with open permissions: ugo+rw Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:46 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:46 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:46 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.452s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-63ee91f7-cf71-4ecf-bcd8-be59596b030b tempest-GroupSnapshotsTest-1152799999 None] Delete group completed successfully. Sep 28 16:13:46 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.375s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Acquiring lock "cinder-9c922586-37fd-49b3-b5be-caa53cb722b6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3a9d0-3965-4bc3-ae04-40f5c35ed4df]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "cinder-9c922586-37fd-49b3-b5be-caa53cb722b6-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c24d6d10-4410-49cd-826c-28de46fdecb2 tempest-VolumesDeleteCascade-891977393 None] Create snapshot completed successfully Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Acquiring lock "cinder-quobyte-9c922586-37fd-49b3-b5be-caa53cb722b6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "cinder-quobyte-9c922586-37fd-49b3-b5be-caa53cb722b6" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[254fa4f1-febf-420b-ac5d-36fd3f8a9476]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:47 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:47 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:47 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 Sep 28 16:13:47 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:47 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.681s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:47 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6" returned: 0 in 0.598s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-1fc057d7-dc90-44ba-93ab-2333403baf8a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:47 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6 Sep 28 16:13:47 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-1fc057d7-dc90-44ba-93ab-2333403baf8a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Performing cascade delete. {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-226239da-b218-49c6-bedb-24de1e136a6d-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-226239da-b218-49c6-bedb-24de1e136a6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 2G" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-226239da-b218-49c6-bedb-24de1e136a6d" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.096s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-226239da-b218-49c6-bedb-24de1e136a6d" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Deleting offline snapshot 226239da-b218-49c6-bedb-24de1e136a6d of volume 1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] snapshot_file for this snap is: volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9111f-7cf9-4ba9-9316-661a306ce9ec]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1fb1883c-05c7-4416-84dc-a0a0e9a76d26 tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-1791516925: creating Sep 28 16:13:48 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9c922586-37fd-49b3-b5be-caa53cb722b6" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c4b2c17d-714a-4fe0-bd26-2446586ce9f7 tempest-VolumesExtendTest-807967192 None] Extend volume completed successfully. Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "cinder-quobyte-9c922586-37fd-49b3-b5be-caa53cb722b6" released by "delete_volume" :: held 1.153s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1fb1883c-05c7-4416-84dc-a0a0e9a76d26 tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-1791516925: created successfully Sep 28 16:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1fb1883c-05c7-4416-84dc-a0a0e9a76d26 tempest-GroupSnapshotsTest-1152799999 None] Create group completed successfully. Sep 28 16:13:48 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:48 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Created reservations ['08323c49-7021-422c-b208-2fabcb400c43', 'ead11916-435d-4923-ac5d-5a48e04c5ee8', 'c9d3c295-c5d1-47c4-b973-8a170b958a78', 'c5fbbafc-116e-403f-9d0e-00374332d75f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:48 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:48 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:48 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc057d7-dc90-44ba-93ab-2333403baf8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16f0366-1d63-42ad-8536-5c88c8d94222]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:48 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Deleted volume successfully. Sep 28 16:13:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ff2143bc-42f1-4b73-9477-b4c33a4e0e86 tempest-VolumesMetadataTest-1389381831 None] Lock "cinder-9c922586-37fd-49b3-b5be-caa53cb722b6-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:48 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:48 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:49 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.570s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daaa468-fcc7-4108-b0a7-025bb62d12f3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-quobyte-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Deleting offline snapshot ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 of volume f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] snapshot_file for this snap is: volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c436b757-5e13-48b0-998d-0162064f0c78]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:49 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:49 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:49 devstack sudo[97381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 Sep 28 16:13:49 devstack sudo[97381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (4b2af6f3-4b42-418d-88fd-6abbf47e6b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ca048b-8442-4338-a76f-ef6f71f1daf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9ca048b-8442-4338-a76f-ef6f71f1daf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949576584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95831eb6-ba05-44a9-a12a-db907555405b,host='devstack@QuobyteHD#QuobyteHD',id=dcccf27f-eaa2-4bb3-9075-38f4dac6249e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:50Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37793c4c-6edf-4943-b3e8-aeaaf1b3b766),volume_type_id=37793c4c-6edf-4943-b3e8-aeaaf1b3b766)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02084d7-fee6-4d40-8f18-71a0b7a3c5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02084d7-fee6-4d40-8f18-71a0b7a3c5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca37bb9-a996-4f67-b9a7-2c555382799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:50 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca37bb9-a996-4f67-b9a7-2c555382799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcccf27f-eaa2-4bb3-9075-38f4dac6249e', 'volume_name': 'volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c301c8-b750-4d85-baa4-759608fcb8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c301c8-b750-4d85-baa4-759608fcb8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a786c7c-4df9-4096-80c9-466aedc3c190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:50 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Volume dcccf27f-eaa2-4bb3-9075-38f4dac6249e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e', 'volume_size': 1} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95831eb6-ba05-44a9-a12a-db907555405b,created_at=2026-09-28T14:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-949576584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95831eb6-ba05-44a9-a12a-db907555405b,host='devstack@QuobyteHD#QuobyteHD',id=dcccf27f-eaa2-4bb3-9075-38f4dac6249e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:50Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37793c4c-6edf-4943-b3e8-aeaaf1b3b766),volume_type_id=37793c4c-6edf-4943-b3e8-aeaaf1b3b766)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Creating volume dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:50 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 1.047s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc057d7-dc90-44ba-93ab-2333403baf8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:50 devstack sudo[97390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e 1073741824 Sep 28 16:13:50 devstack sudo[97390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ac8798-fea2-43ce-a1b4-626dd55ea2ec]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:50 devstack sudo[97381]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" returned: 0 in 0.947s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f500101b-d79a-4046-bb10-d4d2e53f0620(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed68b757-0b96-4e6d-817e-743e56869581]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:50 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:50 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:50 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:50 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:51 devstack sudo[97390]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e 1073741824" returned: 0 in 0.730s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:51 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.623s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:51 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.744s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc057d7-dc90-44ba-93ab-2333403baf8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:51 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 Sep 28 16:13:51 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1cbda0-d9bd-4025-b204-876c2072023b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:51 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e Sep 28 16:13:51 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:51 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:51 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:51 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" returned: 0 in 0.653s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a786c7c-4df9-4096-80c9-466aedc3c190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf0d6a-3b9d-439f-b479-a856e2edeac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Volume volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e (dcccf27f-eaa2-4bb3-9075-38f4dac6249e): created successfully Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddcf0d6a-3b9d-439f-b479-a856e2edeac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (4b2af6f3-4b42-418d-88fd-6abbf47e6b0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-45ff2fde-694a-4d03-8ae0-b061456323a1 tempest-GroupSnapshotsTest-1152799999 None] Created volume successfully. Sep 28 16:13:52 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.799s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:52 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:52 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:52 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" returned: 0 in 0.956s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:52 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1 Sep 28 16:13:52 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:52 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620.ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" returned: 0 in 0.336s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1" released by "_delete_snapshot" :: held 3.082s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" released by "delete_snapshot" :: held 3.128s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:52 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.597s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:52 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d Sep 28 16:13:52 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:52 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Created reservations ['9496dff9-fb5d-4a9c-830a-1ca71a9e013b', '20025515-4049-480f-a55d-11ea588b65e2', '3a31a407-b6de-4a1e-b54b-fb91e4d9490a', '84b8ee9b-d44c-446e-b26e-8bf0d5eb2212'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Delete snapshot completed successfully. Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11c83b34-3177-44bb-8081-d2a4d01bbbf4 tempest-VolumesExtendTest-807967192 None] Lock "cinder-ae1c78b6-3dd1-4ea4-b7c7-a6abe5ff38c1-delete_snapshot" released by "delete_snapshot" :: held 3.560s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:53 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.226239da-b218-49c6-bedb-24de1e136a6d" returned: 0 in 0.538s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b -F qcow2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:53 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b -F qcow2 Sep 28 16:13:53 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:53 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fc057d7-dc90-44ba-93ab-2333403baf8a /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b -F qcow2" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-226239da-b218-49c6-bedb-24de1e136a6d" released by "_delete_snapshot" :: held 5.704s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" released by "delete_snapshot" :: held 5.785s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:53 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Created reservations ['c7a99dd8-229b-4fb5-a80d-1b9115d45709', '75fed592-465f-4bb8-b502-c450d96ae22d', 'd1b082fa-3541-489a-9fd1-15cee32d593f', 'd1b83c4b-d850-4a98-8b72-a62224221e2f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-f500101b-d79a-4046-bb10-d4d2e53f0620-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "cinder-f500101b-d79a-4046-bb10-d4d2e53f0620-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Delete snapshot completed successfully. Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-226239da-b218-49c6-bedb-24de1e136a6d-delete_snapshot" released by "delete_snapshot" :: held 6.328s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-e3b72960-73a0-4f20-89fa-bec993e7ff2b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (706bd88a-33a9-4afb-a117-5009dff068dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3de153b-299c-4743-976e-f3ca8601b543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Acquiring lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-e3b72960-73a0-4f20-89fa-bec993e7ff2b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.108s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3de153b-299c-4743-976e-f3ca8601b543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370440836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95831eb6-ba05-44a9-a12a-db907555405b,host='devstack@QuobyteHD#QuobyteHD',id=c318f5ab-03ac-4be9-9ff7-2863cc7fd52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:54Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37793c4c-6edf-4943-b3e8-aeaaf1b3b766),volume_type_id=37793c4c-6edf-4943-b3e8-aeaaf1b3b766)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71391231-1467-42f2-ba48-4809f2f27252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71391231-1467-42f2-ba48-4809f2f27252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97151e10-f134-4e1e-84ab-29bc70fa07ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97151e10-f134-4e1e-84ab-29bc70fa07ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c318f5ab-03ac-4be9-9ff7-2863cc7fd52a', 'volume_name': 'volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b055b0d5-38e5-4d41-9db5-3a60cffade44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b055b0d5-38e5-4d41-9db5-3a60cffade44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe353684-aacf-46e4-a2db-5a5126df3649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Volume c318f5ab-03ac-4be9-9ff7-2863cc7fd52a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a', 'volume_size': 1} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95831eb6-ba05-44a9-a12a-db907555405b,created_at=2026-09-28T14:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1370440836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95831eb6-ba05-44a9-a12a-db907555405b,host='devstack@QuobyteHD#QuobyteHD',id=c318f5ab-03ac-4be9-9ff7-2863cc7fd52a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:13:54Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(37793c4c-6edf-4943-b3e8-aeaaf1b3b766),volume_type_id=37793c4c-6edf-4943-b3e8-aeaaf1b3b766)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Creating volume c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:13:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" acquired by "delete_volume" :: waited 0.130s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:54 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a 1073741824 Sep 28 16:13:54 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[af58e206-76d8-4039-9f54-1dcc26d1bfb4]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-e3b72960-73a0-4f20-89fa-bec993e7ff2b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e3b72960-73a0-4f20-89fa-bec993e7ff2b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Deleting offline snapshot e3b72960-73a0-4f20-89fa-bec993e7ff2b of volume 1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] snapshot_file for this snap is: volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b140281-7be8-4762-8c9e-26d4327bac7a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:54 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:54 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:54 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:54 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:55 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a 1073741824" returned: 0 in 0.870s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:55 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.782s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:55 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 0.685s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fc057d7-dc90-44ba-93ab-2333403baf8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:13:55 devstack sudo[97455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620 Sep 28 16:13:55 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e140f74-45eb-45b1-83ec-bc999e769eca]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:55 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a Sep 28 16:13:55 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:55 devstack sudo[97458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:55 devstack sudo[97458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:55 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f500101b-d79a-4046-bb10-d4d2e53f0620" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "cinder-quobyte-f500101b-d79a-4046-bb10-d4d2e53f0620" released by "delete_volume" :: held 1.512s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:56 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" returned: 0 in 0.551s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe353684-aacf-46e4-a2db-5a5126df3649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5d766f-9314-45d2-8549-0e4ca71042ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:13:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Volume volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a (c318f5ab-03ac-4be9-9ff7-2863cc7fd52a): created successfully Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed5d766f-9314-45d2-8549-0e4ca71042ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (706bd88a-33a9-4afb-a117-5009dff068dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:13:56 devstack sudo[97458]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.652s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7e0144f1-945f-42ab-866d-e40a1c8c0a75 tempest-GroupSnapshotsTest-1152799999 None] Created volume successfully. Sep 28 16:13:56 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:56 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Created reservations ['3547bd97-4a35-4a46-a39f-694b728b0929', 'd92e83c2-9f1e-4143-810b-bd7093d2b4e0', '13da2c65-e0c5-442e-adc8-640120dd90f4', 'e38f4d36-f3d6-4de9-8d8e-48bff1cfdc76'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:56 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:56 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:56 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:13:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Deleted volume successfully. Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e3c48d23-6b8c-4076-b07a-85a56b23fcfc tempest-VolumesExtendTest-807967192 None] Lock "cinder-f500101b-d79a-4046-bb10-d4d2e53f0620-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:56 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 0.755s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:56 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b Sep 28 16:13:56 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:57 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a.e3b72960-73a0-4f20-89fa-bec993e7ff2b" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e3b72960-73a0-4f20-89fa-bec993e7ff2b" released by "_delete_snapshot" :: held 2.769s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" released by "delete_snapshot" :: held 2.824s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-436f69b0-ef8c-4459-b81a-6c0cedc3dc31 tempest-GroupSnapshotsTest-1152799999 None] Update group completed successfully. Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Created reservations ['e9cc0c1e-9812-4b4c-a704-575b10180798', 'fd2e4c19-9561-424e-9a88-d01fd839a14e', '3015dbb6-9b01-4eb4-b662-8bdee484d8c1', '1caa99ee-5d90-4b2e-8627-4101e0f96a90'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Delete snapshot completed successfully. Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-e3b72960-73a0-4f20-89fa-bec993e7ff2b-delete_snapshot" released by "delete_snapshot" :: held 3.449s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Snapshots deleted, issuing volume delete {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:13:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" acquired by "delete_volume" :: waited 0.053s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:13:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd567f10-2381-4a78-9473-ccfa3e44934f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:13:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:58 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:58 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-139bd744-51ca-4fe3-bd2e-3add35f7719b tempest-GroupSnapshotsTest-1152799999 None] Update group completed successfully. Sep 28 16:13:59 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.984s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:59 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a Sep 28 16:13:59 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:13:59 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fc057d7-dc90-44ba-93ab-2333403baf8a" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-1fc057d7-dc90-44ba-93ab-2333403baf8a" released by "delete_volume" :: held 1.683s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Created reservations ['322e7ebc-2c6d-41e2-8895-f002153831ae', '4af52034-4f72-4731-9876-e3a689499cea', '0416459e-1e33-4221-b61f-a25ad0e9d1cc', '4eef7fd8-e5f5-4ed0-a99e-f528e8176846'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:13:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:13:59 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:13:59 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d30e25df-34d7-4a96-a0d7-d65a202fd966 tempest-GroupSnapshotsTest-1152799999 None] Update group completed successfully. Sep 28 16:14:00 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.493s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Deleted volume successfully. Sep 28 16:14:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4bf8d8e0-2666-486d-860a-6b23adb6a067 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-1fc057d7-dc90-44ba-93ab-2333403baf8a-delete_volume" released by "delete_volume" :: held 12.596s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-68eaa684-34ed-4135-93bc-5154204254f0 tempest-GroupSnapshotsTest-1152799999 None] Update group completed successfully. Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (7fe7aafb-444f-4b90-a9d5-445cb0550e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60880ef-368d-46ef-beb2-f97221924e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f60880ef-368d-46ef-beb2-f97221924e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-685369890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e1266e98d44f2e9f40ee004d3c6f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:02Z,use_quota=True,user_id='4f372162422144a8b2c9ab8a40f74406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fbc6e2-464a-43d6-90e5-20a070ea3170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fbc6e2-464a-43d6-90e5-20a070ea3170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ffbe5-722d-4a70-a88e-3fbd49bee37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46ffbe5-722d-4a70-a88e-3fbd49bee37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db', 'volume_name': 'volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8effbd76-014b-494b-8e25-01db9d4b486c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8effbd76-014b-494b-8e25-01db9d4b486c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e74951-574c-4b9f-8a49-51a593d8646d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Volume 9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db', 'volume_size': 1} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-685369890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e1266e98d44f2e9f40ee004d3c6f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:02Z,use_quota=True,user_id='4f372162422144a8b2c9ab8a40f74406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Creating volume 9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:02 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:02 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db 1073741824 Sep 28 16:14:02 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:03 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db 1073741824" returned: 0 in 0.847s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:03 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:03 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] GroupSnapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: creating. Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Group snapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:03 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.105s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78e74951-574c-4b9f-8a49-51a593d8646d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83857813-ec74-46db-87ac-8550fbcd8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Creating offline snapshot 61ee8927-ecb1-4c34-8649-4248fc2f5655 of volume c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:14:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Volume volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db (9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db): created successfully Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83857813-ec74-46db-87ac-8550fbcd8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (7fe7aafb-444f-4b90-a9d5-445cb0550e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d373b01-4e46-48d4-8858-f73c41b26ad1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ff6b8835-79cf-4f85-bce5-3a2741810221 tempest-VolumesDeleteCascade-891977393 None] Created volume successfully. Sep 28 16:14:03 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a Sep 28 16:14:03 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:04 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" returned: 0 in 0.785s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:04 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 1G Sep 28 16:14:04 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Flow 'volume_create_manager' (82faa12c-600e-45fb-aa07-1e5f7d794328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13478889-2a32-4275-980a-f273561b96f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13478889-2a32-4275-980a-f273561b96f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-289098591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7671e49a-2a47-4d2d-b6d6-f861b32a518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54b7cd8399d47bda172ac772e97bcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:04Z,use_quota=True,user_id='3550cb58a83a4240a0b58c1308b1dee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d72db93-3bbf-420d-82c6-a8ddd5371f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d72db93-3bbf-420d-82c6-a8ddd5371f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8beb175-894c-4bf5-a95b-9481448bdc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8beb175-894c-4bf5-a95b-9481448bdc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7671e49a-2a47-4d2d-b6d6-f861b32a518a', 'volume_name': 'volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634068cb-ab76-4d37-ab52-a46c7cbe0d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (634068cb-ab76-4d37-ab52-a46c7cbe0d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9805ec-5553-4376-908c-bc7ed5f7fd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Volume 7671e49a-2a47-4d2d-b6d6-f861b32a518a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a', 'volume_size': 1} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (035f5158-248e-486d-a9fd-25dfa7072fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:05 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6074e749-a631-441a-9f8e-8a15b8234845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 1G" returned: 0 in 0.712s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6074e749-a631-441a-9f8e-8a15b8234845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2141807857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a146e8-e850-44a9-8b6c-690e1f6e6db4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:05Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335aa5b0-2737-4d53-be51-c225c8e45e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:05 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (335aa5b0-2737-4d53-be51-c225c8e45e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:05 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c36aca-c7e8-4a78-bac0-e70cc39d1551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c36aca-c7e8-4a78-bac0-e70cc39d1551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87a146e8-e850-44a9-8b6c-690e1f6e6db4', 'volume_name': 'volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a735e13-016c-4895-8446-fbd5d922e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a735e13-016c-4895-8446-fbd5d922e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdcc0bc-e362-40f9-b245-a0dbfeec6913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Volume 87a146e8-e850-44a9-8b6c-690e1f6e6db4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4', 'volume_size': 1} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:05 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:05 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:05 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 Sep 28 16:14:05 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:05 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:05 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info Sep 28 16:14:05 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:06 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:06 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:06 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info Sep 28 16:14:06 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:06 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.info" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.153s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Creating offline snapshot 868fdafe-0dca-405c-adcd-c5e64022db96 of volume dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c6c2b-0083-42c9-8b34-a286a7fddead]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:06 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e Sep 28 16:14:06 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:07 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:07 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 1G Sep 28 16:14:07 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:07 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 1G" returned: 0 in 0.580s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:07 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 Sep 28 16:14:07 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:08 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:08 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:08 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 Sep 28 16:14:08 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:08 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96" returned: 0 in 0.372s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:08 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info Sep 28 16:14:08 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:09 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:09 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:09 devstack sudo[97593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info Sep 28 16:14:09 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:09 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.info" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.697s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.511s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Creating offline snapshot e6b74618-17de-4682-a7d2-15dfbb70d8bf of volume 9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd54a3a-0187-4315-bde9-6e250d5b9188]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a6b1da0c-47a4-4d19-adf1-628e50c63456 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: created successfully Sep 28 16:14:09 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:09 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:10 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:10 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf 1G Sep 28 16:14:10 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: deleting Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-61ee8927-ecb1-4c34-8649-4248fc2f5655" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61ee8927-ecb1-4c34-8649-4248fc2f5655" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Deleting offline snapshot 61ee8927-ecb1-4c34-8649-4248fc2f5655 of volume c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] snapshot_file for this snap is: volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60792e-74f2-4752-95cc-a13c7428646e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:10 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 Sep 28 16:14:10 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:10 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf 1G" returned: 0 in 0.658s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:10 devstack sudo[97608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:10 devstack sudo[97608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:10 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655" returned: 0 in 0.573s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc43202-1453-4010-a591-027d49b45c09]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a Sep 28 16:14:11 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack sudo[97608]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf is being set with open permissions: ugo+rw Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:11 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" returned: 0 in 0.470s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 Sep 28 16:14:11 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info Sep 28 16:14:11 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:11 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info" returned: 0 in 0.317s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:11 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info is being set with open permissions: ugo+rw Sep 28 16:14:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:11 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info Sep 28 16:14:11 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:12 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655" returned: 0 in 0.547s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:12 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655 Sep 28 16:14:12 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:12 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.info" returned: 0 in 0.330s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.048s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2141807857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87a146e8-e850-44a9-8b6c-690e1f6e6db4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:05Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Creating volume 87a146e8-e850-44a9-8b6c-690e1f6e6db4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:12 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:12 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 1073741824 Sep 28 16:14:12 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-744d4b28-0028-4dcc-a463-9f9ffa65202c tempest-VolumesDeleteCascade-891977393 None] Create snapshot completed successfully Sep 28 16:14:12 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a.61ee8927-ecb1-4c34-8649-4248fc2f5655" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-61ee8927-ecb1-4c34-8649-4248fc2f5655" released by "_delete_snapshot" :: held 2.150s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" released by "delete_snapshot" :: held 2.191s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-868fdafe-0dca-405c-adcd-c5e64022db96" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-868fdafe-0dca-405c-adcd-c5e64022db96" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Deleting offline snapshot 868fdafe-0dca-405c-adcd-c5e64022db96 of volume dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] snapshot_file for this snap is: volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ec5308-808b-471b-bb1e-a79289175deb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:12 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 Sep 28 16:14:12 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:12 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 1073741824" returned: 0 in 0.665s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:13 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 Sep 28 16:14:13 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:13 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96" returned: 0 in 0.586s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e68e3c-7e0f-4504-98e0-c3c7b883deb2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:13 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.595s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-289098591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7671e49a-2a47-4d2d-b6d6-f861b32a518a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a54b7cd8399d47bda172ac772e97bcdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:04Z,use_quota=True,user_id='3550cb58a83a4240a0b58c1308b1dee4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Creating volume 7671e49a-2a47-4d2d-b6d6-f861b32a518a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdcc0bc-e362-40f9-b245-a0dbfeec6913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:13 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e Sep 28 16:14:13 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059ab057-dcc1-453a-b290-c66506e1a610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:13 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a 1073741824 Sep 28 16:14:13 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Volume volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 (87a146e8-e850-44a9-8b6c-690e1f6e6db4): created successfully Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059ab057-dcc1-453a-b290-c66506e1a610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (035f5158-248e-486d-a9fd-25dfa7072fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ee7dab7b-488e-45ef-8c5c-79f39d18a1ce tempest-VolumesListTestJSON-572210891 None] Created volume successfully. Sep 28 16:14:13 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" returned: 0 in 0.632s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:13 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 Sep 28 16:14:13 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:14 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (c101fc2c-e07b-43e1-bfcd-506c46c5e8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74902f5-3521-44d0-8047-c76290015e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a 1073741824" returned: 0 in 0.744s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d74902f5-3521-44d0-8047-c76290015e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1610361346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd634eb0-c899-4d14-bbbd-e0794ef9ffe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76e1266e98d44f2e9f40ee004d3c6f06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e6b74618-17de-4682-a7d2-15dfbb70d8bf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:14Z,use_quota=True,user_id='4f372162422144a8b2c9ab8a40f74406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b157a-a7a8-437f-8d91-181ed8253734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d93b157a-a7a8-437f-8d91-181ed8253734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdabae3-7c15-439c-9db9-2856b13967c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fdabae3-7c15-439c-9db9-2856b13967c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fd634eb0-c899-4d14-bbbd-e0794ef9ffe6', 'volume_name': 'volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6', 'volume_size': 1, 'snapshot_id': 'e6b74618-17de-4682-a7d2-15dfbb70d8bf'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16541b15-e5be-4125-87ac-a09baca990d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16541b15-e5be-4125-87ac-a09baca990d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf96d0f2-669e-42c6-a152-1e0c928f7b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Volume fd634eb0-c899-4d14-bbbd-e0794ef9ffe6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6', 'volume_size': 1, 'snapshot_id': 'e6b74618-17de-4682-a7d2-15dfbb70d8bf'} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:14 devstack sudo[97665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a Sep 28 16:14:14 devstack sudo[97665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:14 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96" returned: 0 in 0.546s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:14 devstack sudo[97670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96 Sep 28 16:14:14 devstack sudo[97670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:14 devstack sudo[97665]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a" returned: 0 in 0.393s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.423s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb9805ec-5553-4376-908c-bc7ed5f7fd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca3464-c4e7-42e2-a025-86f6889e997a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Volume volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a (7671e49a-2a47-4d2d-b6d6-f861b32a518a): created successfully Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0ca3464-c4e7-42e2-a025-86f6889e997a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Flow 'volume_create_manager' (82faa12c-600e-45fb-aa07-1e5f7d794328) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" acquired by "_create_volume_from_snapshot" :: waited 0.077s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Creating volume fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 from snapshot e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0fad3b57-deb8-4dd8-add0-7a03e737f324 tempest-VolumesNegativeTest-2014434393 None] Created volume successfully. Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] snapshot: e6b74618-17de-4682-a7d2-15dfbb70d8bf, volume: fd634eb0-c899-4d14-bbbd-e0794ef9ffe6, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:14:14 devstack sudo[97670]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e.868fdafe-0dca-405c-adcd-c5e64022db96" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e842d4-e9d2-417d-a432-739231bbcade]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-868fdafe-0dca-405c-adcd-c5e64022db96" released by "_delete_snapshot" :: held 2.331s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" released by "delete_snapshot" :: held 2.365s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:15 devstack cinder-volume[87150]: WARNING cinder.quota [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-763902799 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-763902799, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:15 devstack cinder-volume[87150]: WARNING cinder.quota [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-763902799 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-763902799, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['9748471a-9259-449b-885f-17269a62704c', '5fa1578b-e3ff-478a-8fdf-edb1f008f6c8', 'ce798a5e-5993-4034-b876-a9320170e57c', 'ac103eb7-608b-455a-8b22-0968a5c41daa'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:15 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:15 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['25e3a386-2c45-42ff-a169-3b70f709abf5', 'd6dda481-475b-4963-b9c5-174a08db3d30', '2d38c424-00b5-4c3f-9ae7-1985de809014', '60c7f58b-79bb-4400-a793-c20dd93bb725'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b030e3af-890d-4a7b-a414-8e78e04f3796 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 0bfcb7c5-de3c-4564-b0b2-a657b2b66e95: deleted successfully Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (c880f784-bfb7-47b2-9c55-a65789e99c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:15 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e316b4d-705a-4768-8491-54458a4e20c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.695s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e316b4d-705a-4768-8491-54458a4e20c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-302777807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782d3a27-3b15-4f44-8b8b-a66c9fbbed93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:15Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfa96e4-8f2b-428b-bca2-57b915ac3eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfa96e4-8f2b-428b-bca2-57b915ac3eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa31b6-ab5d-4d61-aa10-7ded829e0797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfa31b6-ab5d-4d61-aa10-7ded829e0797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '782d3a27-3b15-4f44-8b8b-a66c9fbbed93', 'volume_name': 'volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b399c75-64be-42ee-86fd-42626229f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b399c75-64be-42ee-86fd-42626229f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72215933-e37e-47fd-94ca-93731488094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Volume 782d3a27-3b15-4f44-8b8b-a66c9fbbed93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93', 'volume_size': 1} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[06eb489c-2e7e-4b2f-9bfb-1560af17cff3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:15 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:15 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:16 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 0.570s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:16 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 Sep 28 16:14:16 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4c002-1a38-40e3-aeae-7b98c7155b1b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:16 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a Sep 28 16:14:16 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:17 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" returned: 0 in 0.703s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:17 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a Sep 28 16:14:17 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:17 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" returned: 0 in 0.672s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-c318f5ab-03ac-4be9-9ff7-2863cc7fd52a" released by "delete_volume" :: held 1.497s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34464f84-e581-4285-b06b-19f06af71f12]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:18 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e Sep 28 16:14:18 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:19 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" returned: 0 in 1.072s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:19 devstack sudo[97717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e Sep 28 16:14:19 devstack sudo[97717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:19 devstack sudo[97717]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" returned: 0 in 0.563s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-dcccf27f-eaa2-4bb3-9075-38f4dac6249e" released by "delete_volume" :: held 1.817s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:19 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=157,cinder:INSERT=40,cinder:UPDATE=152,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['3f9cbe56-b69d-42ca-a576-aed3f84fc403'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:20 devstack cinder-volume[87150]: WARNING cinder.quota [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-763902799 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-763902799, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['2de6cec0-0af8-4c1a-bc45-e17bce1042a4', 'b7da5aa6-6e80-47f1-bf5f-5c05eb7f23f7', '5e145627-d99e-45d1-804a-cc6f2f1c0237', 'e6af04a3-4a03-4c78-a75e-19633819a2e2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['9193ef4b-ef0e-48ee-8f73-32e476810aa9', '7985daf8-1214-431a-86c0-eeb50d2f8282', '11df4fe5-520e-45f8-bf8e-595b036f5eb0', 'd7502780-d879-4e8e-8e2c-659a6f948132'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:21 devstack sudo[97730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:21 devstack sudo[97730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:21 devstack sudo[97730]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.565s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:21 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aa79cbff-7d05-4d3b-bdbc-dde8e3196389 tempest-GroupSnapshotsTest-1152799999 None] Delete group completed successfully. Sep 28 16:14:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2c1d3e48-f453-4b90-b2a6-6c34cbad6613 tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-617803679: creating Sep 28 16:14:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2c1d3e48-f453-4b90-b2a6-6c34cbad6613 tempest-GroupSnapshotsTest-1152799999 None] Group tempest-GroupSnapshotsTest-Group-617803679: created successfully Sep 28 16:14:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2c1d3e48-f453-4b90-b2a6-6c34cbad6613 tempest-GroupSnapshotsTest-1152799999 None] Create group completed successfully. Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (0d3adc92-6d1b-421c-9c3d-4a213dda89fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf929a-9aef-4788-bd65-0b5bbe469ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddbf929a-9aef-4788-bd65-0b5bbe469ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1716101154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83932386-8314-464c-9506-fe98c056b3bb,host='devstack@QuobyteHD#QuobyteHD',id=4845a394-ef15-43e6-b168-d9cca9c642e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:26Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19d93813-6dfa-4e21-8d31-52dfcdbb1757),volume_type_id=19d93813-6dfa-4e21-8d31-52dfcdbb1757)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae02b00-c1fd-42ac-9547-2fdc72ea4e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ae02b00-c1fd-42ac-9547-2fdc72ea4e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182f6841-951e-4e22-900c-8e8842291240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (182f6841-951e-4e22-900c-8e8842291240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4845a394-ef15-43e6-b168-d9cca9c642e4', 'volume_name': 'volume-4845a394-ef15-43e6-b168-d9cca9c642e4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3dd969-c59d-4d82-b63d-7b001f0cae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3dd969-c59d-4d82-b63d-7b001f0cae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6edfe9-0854-4207-a77e-214e87cc4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Volume 4845a394-ef15-43e6-b168-d9cca9c642e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4845a394-ef15-43e6-b168-d9cca9c642e4', 'volume_size': 1} Sep 28 16:14:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:27 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" returned: 0 in 11.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db, size 1024.00 MB, duration 11.34 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:14:27 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Converted 1024.00 MB image at 90.26 MB/s Sep 28 16:14:27 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 is being set with open permissions: ugo+rw Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:27 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 Sep 28 16:14:27 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:27 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" released by "_copy_volume_from_snapshot" :: held 13.162s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" released by "_create_volume_from_snapshot" :: held 13.270s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.349s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.361s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-302777807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=782d3a27-3b15-4f44-8b8b-a66c9fbbed93,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:15Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Creating volume 782d3a27-3b15-4f44-8b8b-a66c9fbbed93 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:27 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:28 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 1073741824 Sep 28 16:14:28 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf96d0f2-669e-42c6-a152-1e0c928f7b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6', 'volume_size': 1, 'snapshot_id': 'e6b74618-17de-4682-a7d2-15dfbb70d8bf'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1600c0-3b98-4196-b7a1-4b93f6b8a5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Volume volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 (fd634eb0-c899-4d14-bbbd-e0794ef9ffe6): created successfully Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb1600c0-3b98-4196-b7a1-4b93f6b8a5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Flow 'volume_create_manager' (c101fc2c-e07b-43e1-bfcd-506c46c5e8f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0be0bb15-ec40-41aa-9251-f4d1df9c20ca tempest-VolumesDeleteCascade-891977393 None] Created volume successfully. Sep 28 16:14:28 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 1073741824" returned: 0 in 0.767s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:28 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 Sep 28 16:14:28 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:29 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" returned: 0 in 0.542s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83932386-8314-464c-9506-fe98c056b3bb,created_at=2026-09-28T14:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1716101154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83932386-8314-464c-9506-fe98c056b3bb,host='devstack@QuobyteHD#QuobyteHD',id=4845a394-ef15-43e6-b168-d9cca9c642e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ad0f6d6fb545c0ae95f27955b4dc4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:26Z,use_quota=True,user_id='6fe299a01abb441baf48059af087d3f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(19d93813-6dfa-4e21-8d31-52dfcdbb1757),volume_type_id=19d93813-6dfa-4e21-8d31-52dfcdbb1757)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Creating volume 4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72215933-e37e-47fd-94ca-93731488094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b4522-9d48-4f9a-af39-7e75570fb4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:29 devstack sudo[97794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 1073741824 Sep 28 16:14:29 devstack sudo[97794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Volume volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 (782d3a27-3b15-4f44-8b8b-a66c9fbbed93): created successfully Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274b4522-9d48-4f9a-af39-7e75570fb4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (c880f784-bfb7-47b2-9c55-a65789e99c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ec2e4860-3fdd-4cce-a4e6-b933d136951b tempest-VolumesListTestJSON-572210891 None] Created volume successfully. Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Performing cascade delete. {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-e6b74618-17de-4682-a7d2-15dfbb70d8bf-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-e6b74618-17de-4682-a7d2-15dfbb70d8bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf" acquired by "_delete_snapshot" :: waited 0.055s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Deleting offline snapshot e6b74618-17de-4682-a7d2-15dfbb70d8bf of volume 9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] snapshot_file for this snap is: volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11ce6de-4954-4ab9-afeb-66837d477e6f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:30 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:30 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:30 devstack sudo[97794]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 1073741824" returned: 0 in 1.189s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:30 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 Sep 28 16:14:30 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:31 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:31 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.899s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f6edfe9-0854-4207-a77e-214e87cc4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4845a394-ef15-43e6-b168-d9cca9c642e4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386acd3c-1940-46a5-aa16-0fe7588a62d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64c4be3-19a0-42a7-ad16-18d4c353a264]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Volume volume-4845a394-ef15-43e6-b168-d9cca9c642e4 (4845a394-ef15-43e6-b168-d9cca9c642e4): created successfully Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386acd3c-1940-46a5-aa16-0fe7588a62d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Flow 'volume_create_manager' (0d3adc92-6d1b-421c-9c3d-4a213dda89fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-34cb4aaa-411f-4011-805d-406641b0460f tempest-GroupSnapshotsTest-1152799999 None] Created volume successfully. Sep 28 16:14:31 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:31 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (8511ff41-c351-42db-a3c5-115ea0896b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a65f371-6629-46c9-8bf9-3d04421d96d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a65f371-6629-46c9-8bf9-3d04421d96d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2008416613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d37df-8052-4f2f-bd1e-fafb1b7ccba9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:32Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f163fb-6c37-4715-935a-dc60c01c248a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f163fb-6c37-4715-935a-dc60c01c248a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e6927-fb82-4158-9545-f740e16b000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab6e6927-fb82-4158-9545-f740e16b000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '256d37df-8052-4f2f-bd1e-fafb1b7ccba9', 'volume_name': 'volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ee81f-a6a3-4fcd-abff-06e9f6a22c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151ee81f-a6a3-4fcd-abff-06e9f6a22c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852c5105-aef3-41e9-8b6d-647efeb3a7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Volume 256d37df-8052-4f2f-bd1e-fafb1b7ccba9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9', 'volume_size': 1} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2008416613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=256d37df-8052-4f2f-bd1e-fafb1b7ccba9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='392a61066bc54d7d92a2d6aa2d49b618',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:14:32Z,use_quota=True,user_id='f0730ff675c14582a390784a7316f4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Creating volume 256d37df-8052-4f2f-bd1e-fafb1b7ccba9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:14:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:14:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[97851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 1073741824 Sep 28 16:14:32 devstack sudo[97851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] GroupSnapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: creating. Sep 28 16:14:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Group snapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: creating. {{(pid=87150) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 28 16:14:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:32 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 1.172s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:32 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:32 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:32 devstack sudo[97851]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 1073741824" returned: 0 in 0.947s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 Sep 28 16:14:33 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.749s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf Sep 28 16:14:33 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.130s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (852c5105-aef3-41e9-8b6d-647efeb3a7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3207fca-73d3-492d-be77-f6eb545ff88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Creating offline snapshot fa801039-f913-4d47-a370-1ed6f2fcd69c of volume 4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:14:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Volume volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 (256d37df-8052-4f2f-bd1e-fafb1b7ccba9): created successfully Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3207fca-73d3-492d-be77-f6eb545ff88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Flow 'volume_create_manager' (8511ff41-c351-42db-a3c5-115ea0896b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b21ca7-c522-4aff-9a13-233dbb4d47c2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-74ebeb8d-dd78-4973-9c18-d7c67fab3df1 tempest-VolumesListTestJSON-572210891 None] Created volume successfully. Sep 28 16:14:33 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db.e6b74618-17de-4682-a7d2-15dfbb70d8bf" returned: 0 in 0.506s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:33 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 Sep 28 16:14:33 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-e6b74618-17de-4682-a7d2-15dfbb70d8bf" released by "_delete_snapshot" :: held 3.613s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" released by "delete_snapshot" :: held 3.694s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Created reservations ['11f16241-c311-458a-a6f5-5ce1d93332a8', '185c5538-75ea-46f8-a9d8-9201868bed26', '62661319-13ba-4969-9401-f96b4e2003b9', '0d6bbd2c-cca5-4d4b-8bbb-9f97c454f936'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Delete snapshot completed successfully. Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-e6b74618-17de-4682-a7d2-15dfbb70d8bf-delete_snapshot" released by "delete_snapshot" :: held 4.175s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Snapshots deleted, issuing volume delete {{(pid=87150) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:34 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4" returned: 0 in 0.695s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa565f8-d31d-4628-b73f-284a32e1f629]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:34 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c 1G Sep 28 16:14:34 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:34 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:34 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 0.726s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:35 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db Sep 28 16:14:35 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c 1G" returned: 0 in 0.915s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845a394-ef15-43e6-b168-d9cca9c642e4 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:35 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845a394-ef15-43e6-b168-d9cca9c642e4 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c Sep 28 16:14:35 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" returned: 0 in 0.609s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db" released by "delete_volume" :: held 1.487s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:35 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4845a394-ef15-43e6-b168-d9cca9c642e4 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c" returned: 0 in 0.579s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Created reservations ['16ecef80-4a7c-4d14-90a3-2e3eab9c667d', '775d1b4d-0456-48f1-b84e-95d303811617', 'd1aad9aa-4a57-43ac-b779-841f4b1704d5', '31d3a7f2-a86b-4cf1-ae98-328412c213f3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:35 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c Sep 28 16:14:35 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:36 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:36 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:36 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c" returned: 0 in 0.621s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:36 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.552s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:36 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:36 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Deleted volume successfully. Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:36 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info Sep 28 16:14:36 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9090a8c1-9496-48c3-8476-2caeded3d91c tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-9b9c9ffc-2d43-49df-a9fa-7fb8de3d09db-delete_volume" released by "delete_volume" :: held 6.876s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:37 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:14:37 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info" returned: 0 in 0.707s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:37 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:37 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info Sep 28 16:14:37 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe7b3fc-4847-4c40-9f47-afb77d5d45cc]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:37 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 Sep 28 16:14:37 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:37 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.info" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.323s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a9134c5d-12bc-4cc0-8191-34b50ace8216 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: created successfully Sep 28 16:14:38 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" returned: 0 in 0.753s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:38 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6 Sep 28 16:14:38 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:38 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-quobyte-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6" released by "delete_volume" :: held 1.180s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Created reservations ['8ef0925c-5bd5-48f3-a824-8bbe19b06166', '75ce26a3-11a7-42a1-99c1-838509fec48d', 'b2be22ca-c178-4901-ad9d-321e5ecfc335', 'ba8b5e99-091b-49c1-9281-f4b9f8cefe23'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:38 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:38 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: deleting Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: deleting {{(pid=87150) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-fa801039-f913-4d47-a370-1ed6f2fcd69c" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-fa801039-f913-4d47-a370-1ed6f2fcd69c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Deleting offline snapshot fa801039-f913-4d47-a370-1ed6f2fcd69c of volume 4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] snapshot_file for this snap is: volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a22198c-c4d4-43a6-af1a-d695b21e7bde]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:39 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Deleted volume successfully. Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-de7d81b2-235b-4ed0-8db6-f4cfc4b55b75 tempest-VolumesDeleteCascade-891977393 None] Lock "cinder-fd634eb0-c899-4d14-bbbd-e0794ef9ffe6-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-256d37df-8052-4f2f-bd1e-fafb1b7ccba9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-256d37df-8052-4f2f-bd1e-fafb1b7ccba9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:39 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c Sep 28 16:14:39 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-quobyte-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8561ec-87ae-4bde-a569-87f785d1237e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:39 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 Sep 28 16:14:39 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:39 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c" returned: 0 in 0.666s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4845a394-ef15-43e6-b168-d9cca9c642e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[407276e8-458d-45fc-b65e-9d330b08d952]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:40 devstack sudo[97957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 Sep 28 16:14:40 devstack sudo[97957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:40 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" returned: 0 in 0.682s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:40 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9 Sep 28 16:14:40 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:40 devstack sudo[97957]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4" returned: 0 in 0.650s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:40 devstack sudo[97969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c Sep 28 16:14:40 devstack sudo[97969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:40 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" returned: 0 in 0.472s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-256d37df-8052-4f2f-bd1e-fafb1b7ccba9" released by "delete_volume" :: held 1.217s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Created reservations ['1596f1de-bccf-45ff-9a1d-2bfdc305a819', 'be676021-90ae-4bce-848b-a2c6c0409f98', '13be1181-40b6-4cbf-bde3-1a22f8d40cb4', '369f73b5-f92c-48e2-b824-658084736862'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:41 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:41 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:41 devstack sudo[97969]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c" returned: 0 in 0.520s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:41 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c Sep 28 16:14:41 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:41 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Deleted volume successfully. Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1df176d0-99c7-402f-98a0-2d11966a8fa0 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-256d37df-8052-4f2f-bd1e-fafb1b7ccba9-delete_volume" released by "delete_volume" :: held 1.941s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:41 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4.fa801039-f913-4d47-a370-1ed6f2fcd69c" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-fa801039-f913-4d47-a370-1ed6f2fcd69c" released by "_delete_snapshot" :: held 2.425s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" released by "delete_snapshot" :: held 2.463s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:41 devstack cinder-volume[87150]: WARNING cinder.quota [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1260476434 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1260476434, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:41 devstack cinder-volume[87150]: WARNING cinder.quota [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1260476434 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1260476434, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['2e8511da-786f-41ad-9e6c-ddc4ee0612f8', 'cbabeffc-76d8-463e-b7a8-0d97de31b1df', '376d185b-1f09-4331-9b49-7cb8038195bd', 'c8c56d6d-d5e0-4ce1-8632-8f4fe856ed67'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ee4bc8b2-b349-4847-9c9c-023a15a90135 tempest-GroupSnapshotsTest-1152799999 None] group_snapshot 9143a2e3-2e48-44e4-8cc0-8a89ac9eec1e: deleted successfully Sep 28 16:14:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-782d3a27-3b15-4f44-8b8b-a66c9fbbed93-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-782d3a27-3b15-4f44-8b8b-a66c9fbbed93-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-quobyte-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b47023-c607-4554-bb20-95f739aed804]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:42 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 Sep 28 16:14:42 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:42 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" returned: 0 in 0.563s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:42 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93 Sep 28 16:14:42 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" returned: 0 in 0.345s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-782d3a27-3b15-4f44-8b8b-a66c9fbbed93" released by "delete_volume" :: held 0.976s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=145,cinder:INSERT=43,cinder:UPDATE=163,cinder:DELETE=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Created reservations ['34c9d57d-7d01-45de-afba-e5f22ce5ce3a', '7e418f41-981f-4ce4-a2c2-d4fc102dca16', 'a3abe7ff-4352-4692-8615-ed82f4d2c58c', '5b1f3b01-a4db-4682-8e5a-2f872d85f839'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:43 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f07688b-9baf-4a20-9b08-c2d16c5e6082]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:43 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 Sep 28 16:14:43 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:43 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.454s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Deleted volume successfully. Sep 28 16:14:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39b1f551-5765-4a0b-a33b-a5bf94589de8 tempest-VolumesListTestJSON-572210891 None] Lock "cinder-782d3a27-3b15-4f44-8b8b-a66c9fbbed93-delete_volume" released by "delete_volume" :: held 1.814s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:44 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:44 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4 Sep 28 16:14:44 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:44 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-87a146e8-e850-44a9-8b6c-690e1f6e6db4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4845a394-ef15-43e6-b168-d9cca9c642e4" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Lock "cinder-quobyte-4845a394-ef15-43e6-b168-d9cca9c642e4" released by "delete_volume" :: held 1.130s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "cinder-87a146e8-e850-44a9-8b6c-690e1f6e6db4-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Acquiring lock "cinder-quobyte-87a146e8-e850-44a9-8b6c-690e1f6e6db4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-87a146e8-e850-44a9-8b6c-690e1f6e6db4" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['ba4cf550-b9c6-45f8-8187-161f4a0f0034'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9aba3-75c5-475d-95b8-380e6722cc38]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:44 devstack cinder-volume[87150]: WARNING cinder.quota [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1260476434 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1260476434, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:14:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Created reservations ['ba984182-ba49-4cf3-9d12-eaca462f874e', 'de0e31b8-6539-4ec7-b7d0-1bb13c2e53aa', '43082a6c-ed9c-467e-9fbc-828dd5b23358', '6bdfa7ad-cb73-44a6-90a4-2b247f8004b3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:45 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 Sep 28 16:14:45 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:45 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:45 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:45 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4" returned: 0 in 0.795s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:45 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4 Sep 28 16:14:45 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:45 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.536s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:45 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-63f7ff61-8fc1-45d3-b2ba-c3c158888007 tempest-GroupSnapshotsTest-1152799999 None] Delete group completed successfully. Sep 28 16:14:46 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-87a146e8-e850-44a9-8b6c-690e1f6e6db4" returned: 0 in 0.689s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "cinder-quobyte-87a146e8-e850-44a9-8b6c-690e1f6e6db4" released by "delete_volume" :: held 1.577s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Created reservations ['65abb0fa-b8d4-42a5-991d-99988e759bf7', '413a48eb-4d87-4a5b-8c1d-408b7fed6276', '92970f16-6460-4229-a6fc-1be594ac93a2', '5e1b9a1e-0ed5-42ba-9351-88b7b548a034'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:46 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:46 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:47 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.631s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Deleted volume successfully. Sep 28 16:14:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7e8a8669-bbec-4de1-b6d2-601af7158c5c tempest-VolumesListTestJSON-572210891 None] Lock "cinder-87a146e8-e850-44a9-8b6c-690e1f6e6db4-delete_volume" released by "delete_volume" :: held 2.740s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Acquiring lock "cinder-7671e49a-2a47-4d2d-b6d6-f861b32a518a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "cinder-7671e49a-2a47-4d2d-b6d6-f861b32a518a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Acquiring lock "cinder-quobyte-7671e49a-2a47-4d2d-b6d6-f861b32a518a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "cinder-quobyte-7671e49a-2a47-4d2d-b6d6-f861b32a518a" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5602c70-0c09-4488-8f44-60d54c43d255]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:14:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:53 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a Sep 28 16:14:53 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:54 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a" returned: 0 in 0.670s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:54 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a Sep 28 16:14:54 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:54 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7671e49a-2a47-4d2d-b6d6-f861b32a518a" returned: 0 in 0.596s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "cinder-quobyte-7671e49a-2a47-4d2d-b6d6-f861b32a518a" released by "delete_volume" :: held 1.380s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Created reservations ['912e3101-8986-4b05-a0ec-5a87a64e92d3', '608f2a96-4e46-41a7-9503-920126ed2148', 'a84b6af3-63d2-46a8-92e4-5174a268111e', '0f736886-4ae8-44e5-ba2d-f7122d3cd768'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:14:55 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:14:55 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:14:55 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:14:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Deleted volume successfully. Sep 28 16:14:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6306db04-50f3-4b23-81c7-cb0372d7af17 tempest-VolumesNegativeTest-2014434393 None] Lock "cinder-7671e49a-2a47-4d2d-b6d6-f861b32a518a-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:14:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d4b7ba6-133c-4772-808a-73fc6295a548 tempest-GroupsTest-848961351 None] Group tempest-Group1-532603676: creating Sep 28 16:14:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d4b7ba6-133c-4772-808a-73fc6295a548 tempest-GroupsTest-848961351 None] Group tempest-Group1-532603676: created successfully Sep 28 16:14:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d4b7ba6-133c-4772-808a-73fc6295a548 tempest-GroupsTest-848961351 None] Create group completed successfully. Sep 28 16:15:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12a28f00-9d91-4a38-9cc7-296a065bc441 tempest-GroupsTest-848961351 None] Group tempest-Group2-863163519: creating Sep 28 16:15:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12a28f00-9d91-4a38-9cc7-296a065bc441 tempest-GroupsTest-848961351 None] Group tempest-Group2-863163519: created successfully Sep 28 16:15:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12a28f00-9d91-4a38-9cc7-296a065bc441 tempest-GroupsTest-848961351 None] Create group completed successfully. Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (607faf2d-0073-4c6e-9d5d-96e1b25ca486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ff77d-94c1-47a4-91df-955ba41493bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d79ff77d-94c1-47a4-91df-955ba41493bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55453264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e6d0f0-73b0-4354-8eee-796121b088e9,host='devstack@QuobyteHD#QuobyteHD',id=b3c157b5-9178-4b2e-8a42-5a5ddbefaff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:03Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cadd2bd-2c73-42a1-bfde-485db55ff86d),volume_type_id=6cadd2bd-2c73-42a1-bfde-485db55ff86d)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49f8a00-98b1-4dcd-9de4-aeeea650dbf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a49f8a00-98b1-4dcd-9de4-aeeea650dbf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5d374b-e9f7-41d4-abdc-80bdeccde90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb5d374b-e9f7-41d4-abdc-80bdeccde90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3c157b5-9178-4b2e-8a42-5a5ddbefaff0', 'volume_name': 'volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e128b7-6dc1-4344-beb3-e300be309aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62e128b7-6dc1-4344-beb3-e300be309aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f8c514-f452-45e7-bb5b-f0b58a0d71c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Volume b3c157b5-9178-4b2e-8a42-5a5ddbefaff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0', 'volume_size': 1} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3e6d0f0-73b0-4354-8eee-796121b088e9,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-55453264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e6d0f0-73b0-4354-8eee-796121b088e9,host='devstack@QuobyteHD#QuobyteHD',id=b3c157b5-9178-4b2e-8a42-5a5ddbefaff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:03Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6cadd2bd-2c73-42a1-bfde-485db55ff86d),volume_type_id=6cadd2bd-2c73-42a1-bfde-485db55ff86d)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Creating volume b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:03 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 1073741824 Sep 28 16:15:03 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Flow 'volume_create_manager' (7e23e919-3c6e-4778-8c10-74e6b4278717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95de9050-d966-4816-90f5-9e148f3e865c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95de9050-d966-4816-90f5-9e148f3e865c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743161834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7b06ca-d632-4a93-9da8-08dacf9352da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230cdb996072435883d3829db37a67ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:04Z,use_quota=True,user_id='fedcc22a8d38486ebf232361a125e27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ecbb9d-bca0-4cc8-9391-22df18a858f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ecbb9d-bca0-4cc8-9391-22df18a858f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde64f-a634-4885-aa66-84fc21bb23ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4dde64f-a634-4885-aa66-84fc21bb23ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a7b06ca-d632-4a93-9da8-08dacf9352da', 'volume_name': 'volume-1a7b06ca-d632-4a93-9da8-08dacf9352da', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038af0ac-a447-44cd-b6a2-e86af6681506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (038af0ac-a447-44cd-b6a2-e86af6681506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4d17f4-96b0-410e-bcea-8674c6e9d6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Volume 1a7b06ca-d632-4a93-9da8-08dacf9352da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a7b06ca-d632-4a93-9da8-08dacf9352da', 'volume_size': 1} Sep 28 16:15:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:04 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 1073741824" returned: 0 in 0.842s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:04 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 Sep 28 16:15:04 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:05 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1743161834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a7b06ca-d632-4a93-9da8-08dacf9352da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='230cdb996072435883d3829db37a67ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:04Z,use_quota=True,user_id='fedcc22a8d38486ebf232361a125e27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Creating volume 1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:05 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:05 devstack sudo[98084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da 1073741824 Sep 28 16:15:05 devstack sudo[98084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f8c514-f452-45e7-bb5b-f0b58a0d71c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87814282-4981-4206-92a9-ad6e70221a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Volume volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 (b3c157b5-9178-4b2e-8a42-5a5ddbefaff0): created successfully Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87814282-4981-4206-92a9-ad6e70221a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (607faf2d-0073-4c6e-9d5d-96e1b25ca486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-82718dcd-868f-4412-9e1a-ba5fbed007da tempest-GroupsTest-848961351 None] Created volume successfully. Sep 28 16:15:05 devstack sudo[98084]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da 1073741824" returned: 0 in 0.762s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:06 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:15:06 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:06 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4d17f4-96b0-410e-bcea-8674c6e9d6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a7b06ca-d632-4a93-9da8-08dacf9352da', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afa00d5-4211-4777-afee-72536b5b8925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Volume volume-1a7b06ca-d632-4a93-9da8-08dacf9352da (1a7b06ca-d632-4a93-9da8-08dacf9352da): created successfully Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0afa00d5-4211-4777-afee-72536b5b8925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Flow 'volume_create_manager' (7e23e919-3c6e-4778-8c10-74e6b4278717) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-71ab2fda-2297-4746-b77a-9c167c78e7ff tempest-VolumesActionsTest-1495633281 None] Created volume successfully. Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Acquiring lock "cinder-quobyte-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[039b1664-2975-4b90-852e-d3f3bb5419fe]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:07 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 Sep 28 16:15:07 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:07 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" returned: 0 in 0.553s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:07 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0 Sep 28 16:15:07 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:08 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-b3c157b5-9178-4b2e-8a42-5a5ddbefaff0" released by "delete_volume" :: held 1.012s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Created reservations ['31258fb2-2d6f-40a2-8867-2189faae0777'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:08 devstack cinder-volume[87150]: WARNING cinder.quota [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1349546505 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1349546505, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:15:08 devstack cinder-volume[87150]: WARNING cinder.quota [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1349546505 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1349546505, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Created reservations ['ab152caf-4d03-4b65-a75e-e48ec4711d9f', '6f3627c7-2e46-4017-a311-b96fef59ea09', '69063a0a-5000-487f-ba2c-8cd971b85a24', '507868be-f220-41b5-8094-6d23a49e7f1d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:08 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:15:08 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:08 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.361s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:08 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-55f62cdf-7380-408d-87bb-efcdc2daaa99 tempest-GroupsTest-848961351 None] Delete group completed successfully. Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Created reservations ['4932d95b-b178-4111-b892-0775c8eb45c7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:09 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:15:09 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:10 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:10 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4fcc49a1-370a-4b62-a37a-438801c802db tempest-GroupsTest-848961351 None] Delete group completed successfully. Sep 28 16:15:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3781efc7-02e7-47fb-af0c-76b3d966014e tempest-GroupsTest-848961351 None] Group tempest-GroupsTest-Group-1614910565: creating Sep 28 16:15:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3781efc7-02e7-47fb-af0c-76b3d966014e tempest-GroupsTest-848961351 None] Group tempest-GroupsTest-Group-1614910565: created successfully Sep 28 16:15:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3781efc7-02e7-47fb-af0c-76b3d966014e tempest-GroupsTest-848961351 None] Create group completed successfully. Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (62d53f21-3eb9-4099-a044-610d2149f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4561c-8aa3-4786-86e0-4e7d28c813dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b4561c-8aa3-4786-86e0-4e7d28c813dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650479861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,host='devstack@QuobyteHD#QuobyteHD',id=e7c6559b-7217-4120-b692-f006ad11c162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:14Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c0ed2-861b-42ea-810a-2440a227285c),volume_type_id=616c0ed2-861b-42ea-810a-2440a227285c)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59523433-8702-494a-aa0e-4885418c9b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59523433-8702-494a-aa0e-4885418c9b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e88754-a045-4e7f-945e-29bda3c76513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e88754-a045-4e7f-945e-29bda3c76513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c6559b-7217-4120-b692-f006ad11c162', 'volume_name': 'volume-e7c6559b-7217-4120-b692-f006ad11c162', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feec7ad0-c649-404a-903d-00a38655f84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feec7ad0-c649-404a-903d-00a38655f84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8acd7a7-2ecb-4551-a708-67208de277bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Volume e7c6559b-7217-4120-b692-f006ad11c162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c6559b-7217-4120-b692-f006ad11c162', 'volume_size': 1} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,created_at=2026-09-28T14:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-650479861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,host='devstack@QuobyteHD#QuobyteHD',id=e7c6559b-7217-4120-b692-f006ad11c162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:14Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c0ed2-861b-42ea-810a-2440a227285c),volume_type_id=616c0ed2-861b-42ea-810a-2440a227285c)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Creating volume e7c6559b-7217-4120-b692-f006ad11c162 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:13 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 1073741824 Sep 28 16:15:13 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:14 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 1073741824" returned: 0 in 0.680s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:14 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 Sep 28 16:15:14 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:15 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162" returned: 0 in 0.613s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8acd7a7-2ecb-4551-a708-67208de277bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c6559b-7217-4120-b692-f006ad11c162', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719d3a3a-2461-46a5-83bd-7dedaa220f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Volume volume-e7c6559b-7217-4120-b692-f006ad11c162 (e7c6559b-7217-4120-b692-f006ad11c162): created successfully Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (719d3a3a-2461-46a5-83bd-7dedaa220f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (62d53f21-3eb9-4099-a044-610d2149f35e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-496b974e-60fe-4b8d-9c23-c01e88d7278e tempest-GroupsTest-848961351 None] Created volume successfully. Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (91bec99b-8204-4b28-8784-2ece3b619702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a45bc6-3a53-436a-814b-f28205ae024c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a45bc6-3a53-436a-814b-f28205ae024c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-675807887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,host='devstack@QuobyteHD#QuobyteHD',id=8efd7902-2a0c-47e6-b770-3d364fe68cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:18Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c0ed2-861b-42ea-810a-2440a227285c),volume_type_id=616c0ed2-861b-42ea-810a-2440a227285c)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d06f6a-20ea-40aa-9b89-987cec93dbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8d06f6a-20ea-40aa-9b89-987cec93dbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76060f76-b558-4d9e-9c78-577261f7887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76060f76-b558-4d9e-9c78-577261f7887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8efd7902-2a0c-47e6-b770-3d364fe68cb6', 'volume_name': 'volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69bb65e-4c98-4ac7-8701-baaec35bc183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b69bb65e-4c98-4ac7-8701-baaec35bc183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a933420-0090-4d63-8b9c-23a429e22d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Volume 8efd7902-2a0c-47e6-b770-3d364fe68cb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6', 'volume_size': 1} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,created_at=2026-09-28T14:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-675807887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=184bdd5d-8f13-4fa4-b647-f23d9a666027,host='devstack@QuobyteHD#QuobyteHD',id=8efd7902-2a0c-47e6-b770-3d364fe68cb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='113fb415f70641f3a5ab1d37b250f432',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:18Z,use_quota=True,user_id='47f04a7f985c45048b0c789aee9bb641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(616c0ed2-861b-42ea-810a-2440a227285c),volume_type_id=616c0ed2-861b-42ea-810a-2440a227285c)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Creating volume 8efd7902-2a0c-47e6-b770-3d364fe68cb6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:18 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 1073741824 Sep 28 16:15:18 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:18 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 1073741824" returned: 0 in 0.870s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:19 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 Sep 28 16:15:19 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:19 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6" returned: 0 in 0.649s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (b6b3d928-c0a4-4b63-ad0b-cbec37971de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d630b0c-616b-4862-9b12-a4ce853609f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a933420-0090-4d63-8b9c-23a429e22d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f70404-840a-41d4-91d1-7a1336e95a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d630b0c-616b-4862-9b12-a4ce853609f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922974684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c887befe-923a-45d9-8b0d-5116a8c1c3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:20Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c932c-13b7-4517-9023-ac9c7adfd519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80c932c-13b7-4517-9023-ac9c7adfd519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9002d954-5097-444f-b345-1f029339c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9002d954-5097-444f-b345-1f029339c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c887befe-923a-45d9-8b0d-5116a8c1c3b8', 'volume_name': 'volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7b4640-91d4-4e25-ab0b-c7a26ea42c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c7b4640-91d4-4e25-ab0b-c7a26ea42c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc5e1ad-234e-4c2e-8cc3-64b74a83dac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Volume c887befe-923a-45d9-8b0d-5116a8c1c3b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8', 'volume_size': 1} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1922974684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c887befe-923a-45d9-8b0d-5116a8c1c3b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:20Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Creating volume c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:19 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Volume volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 (8efd7902-2a0c-47e6-b770-3d364fe68cb6): created successfully Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2f70404-840a-41d4-91d1-7a1336e95a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:19 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 1073741824 Sep 28 16:15:19 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Flow 'volume_create_manager' (91bec99b-8204-4b28-8784-2ece3b619702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-524a0a46-3a01-4f96-95f6-b9c3901f23b4 tempest-GroupsTest-848961351 None] Created volume successfully. Sep 28 16:15:20 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 1073741824" returned: 0 in 0.860s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:20 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=102,cinder:INSERT=31,cinder:UPDATE=126,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:20 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 Sep 28 16:15:20 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3cca7157-c169-48b5-8502-d42ded697cf1 tempest-GroupsTest-848961351 None] Update group completed successfully. Sep 28 16:15:21 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8" returned: 0 in 0.623s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dc5e1ad-234e-4c2e-8cc3-64b74a83dac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951bcaf6-5654-449c-8f8f-b995d76e9c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Volume volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 (c887befe-923a-45d9-8b0d-5116a8c1c3b8): created successfully Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (951bcaf6-5654-449c-8f8f-b995d76e9c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (b6b3d928-c0a4-4b63-ad0b-cbec37971de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0dbb476f-b1d3-4f00-adcd-9e5ec348f920 tempest-VolumesSnapshotTestJSON-89303970 None] Created volume successfully. Sep 28 16:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Creating offline snapshot 7f4956a7-5d5c-467c-8677-34e586acf8c4 of volume c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:15:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[761d4a68-7349-4c57-911e-627d51fc5d66]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:22 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 Sep 28 16:15:22 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5a15234b-5307-40ae-aaee-888e7ebbf169 tempest-GroupsTest-848961351 None] Update group completed successfully. Sep 28 16:15:23 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8" returned: 0 in 0.701s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:23 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 1G Sep 28 16:15:23 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:23 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 1G" returned: 0 in 0.711s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:23 devstack sudo[98174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 Sep 28 16:15:23 devstack sudo[98174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:24 devstack sudo[98174]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 is being set with open permissions: ugo+rw Sep 28 16:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:24 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 Sep 28 16:15:24 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:24 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:24 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info Sep 28 16:15:25 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Acquiring lock "cinder-quobyte-8efd7902-2a0c-47e6-b770-3d364fe68cb6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-8efd7902-2a0c-47e6-b770-3d364fe68cb6" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:25 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info" returned: 0 in 0.572s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:25 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info is being set with open permissions: ugo+rw Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[007eea79-178c-419d-a40a-fa028f58b8ad]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:25 devstack sudo[98186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info Sep 28 16:15:25 devstack sudo[98186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:25 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 Sep 28 16:15:25 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:25 devstack sudo[98186]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.info" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.526s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-611f84d5-6fd8-44a5-895c-169cb8903510 tempest-VolumesSnapshotTestJSON-89303970 None] Create snapshot completed successfully Sep 28 16:15:26 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6" returned: 0 in 0.741s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:26 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6 Sep 28 16:15:26 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:26 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8efd7902-2a0c-47e6-b770-3d364fe68cb6" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-8efd7902-2a0c-47e6-b770-3d364fe68cb6" released by "delete_volume" :: held 1.383s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Acquiring lock "cinder-quobyte-e7c6559b-7217-4120-b692-f006ad11c162" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-e7c6559b-7217-4120-b692-f006ad11c162" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d79f9d-56f2-417f-ac24-7a798034047c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-7f4956a7-5d5c-467c-8677-34e586acf8c4-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-7f4956a7-5d5c-467c-8677-34e586acf8c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:27 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 Sep 28 16:15:27 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-7f4956a7-5d5c-467c-8677-34e586acf8c4" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-7f4956a7-5d5c-467c-8677-34e586acf8c4" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Deleting offline snapshot 7f4956a7-5d5c-467c-8677-34e586acf8c4 of volume c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] snapshot_file for this snap is: volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e828ac-f362-4eeb-91f9-fc52cbb852dd]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:27 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 Sep 28 16:15:27 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:28 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162" returned: 0 in 1.013s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:28 devstack sudo[98235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162 Sep 28 16:15:28 devstack sudo[98235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:28 devstack sudo[98235]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e7c6559b-7217-4120-b692-f006ad11c162" returned: 0 in 0.646s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:28 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "cinder-quobyte-e7c6559b-7217-4120-b692-f006ad11c162" released by "delete_volume" :: held 1.803s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4" returned: 0 in 0.973s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffe8759-ba37-40d4-84d8-5c78d9c2f8c4]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Created reservations ['4fc4a84d-7be8-4c11-a39f-2c9f45e9f09c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:29 devstack sudo[98261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 Sep 28 16:15:29 devstack sudo[98261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:29 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1762821556 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1762821556, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:15:29 devstack cinder-volume[87150]: WARNING cinder.quota [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1762821556 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1762821556, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Created reservations ['e8730576-63a5-4700-a277-da01e75c71f5', 'b751107a-55c7-4805-8f32-33ad22b10c9e', '13048bd9-3aa3-4202-aa38-8acdcd444a5a', '2c26f1ee-5df6-4d15-915f-54ccf4ab803a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Created reservations ['98579cb5-c3b8-4cb4-bada-86576a4f5420', '6db36696-983e-4f32-bf35-19c9df28d239', '3bb31bcf-87bc-4d72-aa9b-20a233e4670d', '5377dc36-b7d8-4dc3-a5d0-da82dd90a24e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack sudo[98261]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8" returned: 0 in 0.930s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:29 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:15:29 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:29 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 Sep 28 16:15:29 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:30 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.803s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:30 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6760bdf4-d148-4071-8868-cfacd4399e41 tempest-GroupsTest-848961351 None] Delete group completed successfully. Sep 28 16:15:30 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4" returned: 0 in 0.999s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:30 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4 Sep 28 16:15:30 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:31 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8.7f4956a7-5d5c-467c-8677-34e586acf8c4" returned: 0 in 0.603s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-7f4956a7-5d5c-467c-8677-34e586acf8c4" released by "_delete_snapshot" :: held 3.901s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" released by "delete_snapshot" :: held 3.965s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['388e4cd9-6747-46c2-a7ee-ba109d08a988', 'fe639610-8d10-4be1-9fbf-788fc2296376', '862c9121-408c-4c5d-b104-3cb81c970893', 'b600c63f-19da-4c82-832d-34f2aac6e71f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Delete snapshot completed successfully. Sep 28 16:15:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7526b58c-6d6c-4f68-aaea-8b20271faa3d tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-7f4956a7-5d5c-467c-8677-34e586acf8c4-delete_snapshot" released by "delete_snapshot" :: held 4.640s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (eadfb283-9ece-4f9a-860d-f14c9a530c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0716eee-2552-4ae8-95cb-7647b1a6de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0716eee-2552-4ae8-95cb-7647b1a6de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1919897282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c76462-8aef-4861-a792-34c7edbc38f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:34Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e796d35-c4c6-42df-aa53-0d10ee16b1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e796d35-c4c6-42df-aa53-0d10ee16b1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29db49c-9cd2-43bc-99cd-eceeed25b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c29db49c-9cd2-43bc-99cd-eceeed25b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70c76462-8aef-4861-a792-34c7edbc38f6', 'volume_name': 'volume-70c76462-8aef-4861-a792-34c7edbc38f6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a86c481-ab5b-4ec6-8491-5f9882d9ce24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a86c481-ab5b-4ec6-8491-5f9882d9ce24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf6e78-68c5-4330-8fd0-718ec0734f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Volume 70c76462-8aef-4861-a792-34c7edbc38f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70c76462-8aef-4861-a792-34c7edbc38f6', 'volume_size': 1} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1919897282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70c76462-8aef-4861-a792-34c7edbc38f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:34Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Creating volume 70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:34 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 1073741824 Sep 28 16:15:34 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:35 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 1073741824" returned: 0 in 0.905s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1cedb82e-68eb-44be-a04b-0159af3efb22 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:35 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:15:35 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1cedb82e-68eb-44be-a04b-0159af3efb22 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" acquired by "attach_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1cedb82e-68eb-44be-a04b-0159af3efb22 tempest-VolumesActionsTest-1495633281 None] Attaching volume 1a7b06ca-d632-4a93-9da8-08dacf9352da to instance e8a967c0-b034-4c7d-a95f-1a45fb47cb74 at mountpoint /dev/vdb on host None. Sep 28 16:15:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1cedb82e-68eb-44be-a04b-0159af3efb22 tempest-VolumesActionsTest-1495633281 None] Attach volume completed successfully. Sep 28 16:15:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1cedb82e-68eb-44be-a04b-0159af3efb22 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" released by "attach_volume" :: held 0.265s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:36 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 0.515s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40cf6e78-68c5-4330-8fd0-718ec0734f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70c76462-8aef-4861-a792-34c7edbc38f6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e466a6-323f-4109-b2bd-2b5dec24774f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Volume volume-70c76462-8aef-4861-a792-34c7edbc38f6 (70c76462-8aef-4861-a792-34c7edbc38f6): created successfully Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e466a6-323f-4109-b2bd-2b5dec24774f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (eadfb283-9ece-4f9a-860d-f14c9a530c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-680d1010-39bc-4372-b145-5eadb36e40d0 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-77e015ab-a069-437c-9642-d8628f342088 tempest-VolumesSnapshotTestJSON-89303970 None] Created volume successfully. Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-680d1010-39bc-4372-b145-5eadb36e40d0 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" acquired by "detach_volume" :: waited 0.060s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-680d1010-39bc-4372-b145-5eadb36e40d0 tempest-VolumesActionsTest-1495633281 None] Detaching volume 1a7b06ca-d632-4a93-9da8-08dacf9352da from instance e8a967c0-b034-4c7d-a95f-1a45fb47cb74. Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-680d1010-39bc-4372-b145-5eadb36e40d0 tempest-VolumesActionsTest-1495633281 None] Detach volume completed successfully. Sep 28 16:15:36 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:15:36 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-680d1010-39bc-4372-b145-5eadb36e40d0 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" released by "detach_volume" :: held 0.194s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:37 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.771s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Creating offline snapshot 48fcca5b-3115-4ee3-be96-c4dcf17c248a of volume 70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fee61a-68f3-4961-80d9-3156979e1866]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:37 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:15:37 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:38 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 0.942s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:38 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a 1G Sep 28 16:15:38 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:39 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a 1G" returned: 0 in 0.777s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c76462-8aef-4861-a792-34c7edbc38f6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:39 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c76462-8aef-4861-a792-34c7edbc38f6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:15:39 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:40 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70c76462-8aef-4861-a792-34c7edbc38f6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.598s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:40 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a is being set with open permissions: ugo+rw Sep 28 16:15:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:40 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:15:40 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:40 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:40 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info Sep 28 16:15:40 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:41 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:41 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info is being set with open permissions: ugo+rw Sep 28 16:15:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:41 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info Sep 28 16:15:41 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:41 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.info" returned: 0 in 0.467s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.976s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c4f6ecd9-f736-410a-9b27-a1da0f9a2246 tempest-VolumesSnapshotTestJSON-89303970 None] Create snapshot completed successfully Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (6d0ccb23-2dae-488e-b7ba-1987ab1aea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f072a5a3-c314-4062-865f-e286731da3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f072a5a3-c314-4062-865f-e286731da3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2113970484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaae57df-3668-430e-817b-cb982d334992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=48fcca5b-3115-4ee3-be96-c4dcf17c248a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:43Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb8193c-cfc4-4593-a6ba-73bff3521958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb8193c-cfc4-4593-a6ba-73bff3521958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749d778f-b193-4016-94e4-d3e25b197c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749d778f-b193-4016-94e4-d3e25b197c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aaae57df-3668-430e-817b-cb982d334992', 'volume_name': 'volume-aaae57df-3668-430e-817b-cb982d334992', 'volume_size': 2, 'snapshot_id': '48fcca5b-3115-4ee3-be96-c4dcf17c248a'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f3352-942a-4db7-a565-294e10214769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a38f3352-942a-4db7-a565-294e10214769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1af9566-7df0-467c-8d0c-b90b3fcea1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Volume aaae57df-3668-430e-817b-cb982d334992: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aaae57df-3668-430e-817b-cb982d334992', 'volume_size': 2, 'snapshot_id': '48fcca5b-3115-4ee3-be96-c4dcf17c248a'} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:INSERT=26,cinder:UPDATE=106,cinder:SELECT=101,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a-aaae57df-3668-430e-817b-cb982d334992" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a-aaae57df-3668-430e-817b-cb982d334992" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Creating volume aaae57df-3668-430e-817b-cb982d334992 from snapshot 48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] snapshot: 48fcca5b-3115-4ee3-be96-c4dcf17c248a, volume: aaae57df-3668-430e-817b-cb982d334992, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bef8060-4978-49fd-a201-edebb4ef58d0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:43 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:15:43 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:44 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.715s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c76462-8aef-4861-a792-34c7edbc38f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:15:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[98eb9a81-d667-4479-b465-a071b4371501]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:44 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:15:44 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:45 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 0.762s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:15:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:15:45 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:15:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:45 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 Sep 28 16:15:45 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bf5dc12-0d2c-478e-aa13-bc240af999f4 tempest-GroupsV320Test-2056229615 None] Group tempest-GroupsV320Test-Group-1815563323: creating Sep 28 16:15:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bf5dc12-0d2c-478e-aa13-bc240af999f4 tempest-GroupsV320Test-2056229615 None] Group tempest-GroupsV320Test-Group-1815563323: created successfully Sep 28 16:15:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bf5dc12-0d2c-478e-aa13-bc240af999f4 tempest-GroupsV320Test-2056229615 None] Create group completed successfully. Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Created reservations ['98d7efcf-263f-4ec0-b9aa-c073e5bb6f1b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:48 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:15:48 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:48 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.636s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:48 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:15:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3bf6dde0-11c3-427c-9dfa-ac8ccb72a82a tempest-GroupsV320Test-2056229615 None] Delete group completed successfully. Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Flow 'volume_create_manager' (37ff790c-7a16-4413-b21f-36e9998cbc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d708aa72-e5ba-4b44-b1a1-8cb55d53d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d708aa72-e5ba-4b44-b1a1-8cb55d53d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-210632985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950bfee8-987a-4160-b9f7-37e9cabedccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a1c29aa63a4bf0bce3dd987886da50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:55Z,use_quota=True,user_id='9a0973a64eb54d0bb29dcfb8c2cbce5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9ac495-74ab-43f9-b977-506f5a1738b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f9ac495-74ab-43f9-b977-506f5a1738b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920f5e7-2371-485f-8347-f13c95b2243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d920f5e7-2371-485f-8347-f13c95b2243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950bfee8-987a-4160-b9f7-37e9cabedccc', 'volume_name': 'volume-950bfee8-987a-4160-b9f7-37e9cabedccc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c473f6-05e9-4a07-8c0c-31fce977bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07c473f6-05e9-4a07-8c0c-31fce977bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4c403b-de5f-4b79-a605-b83c61a870ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume 950bfee8-987a-4160-b9f7-37e9cabedccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950bfee8-987a-4160-b9f7-37e9cabedccc', 'volume_size': 1} Sep 28 16:15:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Flow 'volume_create_manager' (e0616368-b6d2-4478-856d-d0f0744994fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e89bd0-5f14-40d4-af02-40db6a7cc179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2e89bd0-5f14-40d4-af02-40db6a7cc179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2142203489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0061754c-b7c8-411f-beda-2cf115a76e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a1c29aa63a4bf0bce3dd987886da50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:57Z,use_quota=True,user_id='9a0973a64eb54d0bb29dcfb8c2cbce5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a57313c-8de6-4a3e-b49b-3be3e4e189c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a57313c-8de6-4a3e-b49b-3be3e4e189c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008e3ad9-ae3c-4df4-8389-7d1d6a5522eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (008e3ad9-ae3c-4df4-8389-7d1d6a5522eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0061754c-b7c8-411f-beda-2cf115a76e41', 'volume_name': 'volume-0061754c-b7c8-411f-beda-2cf115a76e41', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9804b2-a111-4e7a-aee0-740c2b2b1fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f9804b2-a111-4e7a-aee0-740c2b2b1fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254040d2-cf21-4134-b5fc-38d3cca4b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume 0061754c-b7c8-411f-beda-2cf115a76e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0061754c-b7c8-411f-beda-2cf115a76e41', 'volume_size': 1} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:57 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992" returned: 0 in 12.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6, size 1024.00 MB, duration 12.41 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:15:57 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Converted 1024.00 MB image at 82.52 MB/s Sep 28 16:15:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 is being set with open permissions: ugo+rw Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:57 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 Sep 28 16:15:57 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:57 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" released by "_copy_volume_from_snapshot" :: held 14.457s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a-aaae57df-3668-430e-817b-cb982d334992" released by "_create_volume_from_snapshot" :: held 14.606s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.644s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-210632985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950bfee8-987a-4160-b9f7-37e9cabedccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a1c29aa63a4bf0bce3dd987886da50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:55Z,use_quota=True,user_id='9a0973a64eb54d0bb29dcfb8c2cbce5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Creating volume 950bfee8-987a-4160-b9f7-37e9cabedccc {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:58 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc 1073741824 Sep 28 16:15:58 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1af9566-7df0-467c-8d0c-b90b3fcea1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaae57df-3668-430e-817b-cb982d334992', 'volume_size': 2, 'snapshot_id': '48fcca5b-3115-4ee3-be96-c4dcf17c248a'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116c7f44-ccdd-4787-becf-dc4f94dac676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:15:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Volume volume-aaae57df-3668-430e-817b-cb982d334992 (aaae57df-3668-430e-817b-cb982d334992): created successfully Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (116c7f44-ccdd-4787-becf-dc4f94dac676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (6d0ccb23-2dae-488e-b7ba-1987ab1aea2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:15:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0ef81a70-32b4-452a-9f0d-91837ad88c78 tempest-VolumesSnapshotTestJSON-89303970 None] Created volume successfully. Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-aaae57df-3668-430e-817b-cb982d334992-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-aaae57df-3668-430e-817b-cb982d334992-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d58f2-30ba-404d-ad23-732c79a76d6a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:15:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:59 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:59 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 Sep 28 16:15:59 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc 1073741824" returned: 0 in 1.076s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:15:59 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc Sep 28 16:15:59 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:15:59 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc" returned: 0 in 0.727s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.764s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2142203489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0061754c-b7c8-411f-beda-2cf115a76e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9a1c29aa63a4bf0bce3dd987886da50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:15:57Z,use_quota=True,user_id='9a0973a64eb54d0bb29dcfb8c2cbce5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Creating volume 0061754c-b7c8-411f-beda-2cf115a76e41 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:15:59 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:15:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:00 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 1073741824 Sep 28 16:16:00 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4c403b-de5f-4b79-a605-b83c61a870ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950bfee8-987a-4160-b9f7-37e9cabedccc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6004ac-2758-4d67-87be-c5ff9b7e3294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:00 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992" returned: 0 in 1.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume volume-950bfee8-987a-4160-b9f7-37e9cabedccc (950bfee8-987a-4160-b9f7-37e9cabedccc): created successfully Sep 28 16:16:00 devstack sudo[98515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992 Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6004ac-2758-4d67-87be-c5ff9b7e3294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:00 devstack sudo[98515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Flow 'volume_create_manager' (37ff790c-7a16-4413-b21f-36e9998cbc3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-09ce979c-de7c-4782-8c31-ee44327e24db tempest-TestServerVolumeAttachmentScenario-1703243307 None] Created volume successfully. Sep 28 16:16:01 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 1073741824" returned: 0 in 1.175s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:01 devstack sudo[98515]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-aaae57df-3668-430e-817b-cb982d334992" returned: 0 in 1.142s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-aaae57df-3668-430e-817b-cb982d334992" released by "delete_volume" :: held 2.525s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:01 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 Sep 28 16:16:01 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['c5ffd7f5-e0b8-49b1-bc04-be910b219d3f', 'a44e1b96-c8cd-48e9-b6a4-804babd5194e', '332c0561-7956-4512-ab47-2822f71a8d9f', 'e4b613d1-7341-4d9f-b5a3-e4e27626c730'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:01 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:16:01 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:02 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41" returned: 0 in 0.723s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] <== create_volume: return (2055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (254040d2-cf21-4134-b5fc-38d3cca4b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0061754c-b7c8-411f-beda-2cf115a76e41', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bfa30d-949a-4184-a963-c3de2a48a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Volume volume-0061754c-b7c8-411f-beda-2cf115a76e41 (0061754c-b7c8-411f-beda-2cf115a76e41): created successfully Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49bfa30d-949a-4184-a963-c3de2a48a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Flow 'volume_create_manager' (e0616368-b6d2-4478-856d-d0f0744994fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-97975985-1d4f-4797-8dbf-7357be099d8c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Created volume successfully. Sep 28 16:16:02 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.782s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Deleted volume successfully. Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e86ddad-68b6-4dd3-8dc7-be484521afd7 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-aaae57df-3668-430e-817b-cb982d334992-delete_volume" released by "delete_volume" :: held 3.809s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-48fcca5b-3115-4ee3-be96-c4dcf17c248a-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-48fcca5b-3115-4ee3-be96-c4dcf17c248a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Deleting offline snapshot 48fcca5b-3115-4ee3-be96-c4dcf17c248a of volume 70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] snapshot_file for this snap is: volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[413e836d-ecfb-46f6-b21f-32a05e39a849]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:03 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:16:03 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:03 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.750s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70c76462-8aef-4861-a792-34c7edbc38f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8006d3-99c3-45dc-8fd8-1c023567e20d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:03 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:16:03 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:04 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 1.044s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:04 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:16:04 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:05 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.692s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:05 devstack sudo[98601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a Sep 28 16:16:05 devstack sudo[98601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:05 devstack sudo[98601]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6.48fcca5b-3115-4ee3-be96-c4dcf17c248a" returned: 0 in 0.573s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-48fcca5b-3115-4ee3-be96-c4dcf17c248a" released by "_delete_snapshot" :: held 3.343s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" released by "delete_snapshot" :: held 3.444s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['c7b47801-391e-42b9-a450-532775f5aa67', '31ddf15c-49a4-4793-b5e1-7d67f3c2c29d', '28c0423f-8745-4446-b5d2-bfa2fbb7bf0c', 'b8ed3933-1e04-4b0f-a24a-ea8fee0cc5a6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Delete snapshot completed successfully. Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6cc5e452-e11f-4a83-b4b8-01a619c2c5c6 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-48fcca5b-3115-4ee3-be96-c4dcf17c248a-delete_snapshot" released by "delete_snapshot" :: held 3.940s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35cad1b4-0ff3-4640-8b75-03fc5ab48945 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" by "attach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35cad1b4-0ff3-4640-8b75-03fc5ab48945 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" acquired by "attach_volume" :: waited 0.054s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-35cad1b4-0ff3-4640-8b75-03fc5ab48945 tempest-VolumesActionsTest-1495633281 None] Attaching volume 1a7b06ca-d632-4a93-9da8-08dacf9352da to instance 762adb0a-e637-4cf5-a53f-b0d2d27fe400 at mountpoint /dev/vdb on host None. Sep 28 16:16:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-35cad1b4-0ff3-4640-8b75-03fc5ab48945 tempest-VolumesActionsTest-1495633281 None] Attach volume completed successfully. Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-35cad1b4-0ff3-4640-8b75-03fc5ab48945 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da" released by "attach_volume" :: held 0.293s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-70c76462-8aef-4861-a792-34c7edbc38f6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-70c76462-8aef-4861-a792-34c7edbc38f6-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[73384d41-d127-4cd1-be40-fc3e841c90f3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62221c52-15a0-442c-895a-e18b3b65ffdd tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" by "detach_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62221c52-15a0-442c-895a-e18b3b65ffdd tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-62221c52-15a0-442c-895a-e18b3b65ffdd tempest-VolumesActionsTest-1495633281 None] Detaching volume 1a7b06ca-d632-4a93-9da8-08dacf9352da from instance 762adb0a-e637-4cf5-a53f-b0d2d27fe400. Sep 28 16:16:08 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:16:08 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-62221c52-15a0-442c-895a-e18b3b65ffdd tempest-VolumesActionsTest-1495633281 None] Detach volume completed successfully. Sep 28 16:16:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62221c52-15a0-442c-895a-e18b3b65ffdd tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:08 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 1.065s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:09 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6 Sep 28 16:16:09 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:09 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70c76462-8aef-4861-a792-34c7edbc38f6" returned: 0 in 0.697s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-70c76462-8aef-4861-a792-34c7edbc38f6" released by "delete_volume" :: held 1.944s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:09 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['1e364af3-d99f-45e6-91c2-64e917b0fe2c', '23962180-63a6-49a3-a040-9b6ecdc60762', 'a2eadeaa-7aed-420f-ac22-960c69a12ca8', '2b0ed2e0-585c-4df5-a043-15a6ee34af7f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:10 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:16:10 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:10 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.544s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Deleted volume successfully. Sep 28 16:16:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e564467a-e99e-4c69-b0d2-82e10eafbc6e tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-70c76462-8aef-4861-a792-34c7edbc38f6-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (69c7a0bd-ac34-4db0-a640-641f2e89e8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54487b87-8732-49e6-a156-ef285a9e25b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54487b87-8732-49e6-a156-ef285a9e25b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1988872212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0de4b15-bf07-4a95-9f98-1dbb51f32383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:12Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f81ac5-0c1a-4c08-8b7f-944242051567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49f81ac5-0c1a-4c08-8b7f-944242051567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecaa379-7aee-482c-9174-dfbecd9af8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eecaa379-7aee-482c-9174-dfbecd9af8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0de4b15-bf07-4a95-9f98-1dbb51f32383', 'volume_name': 'volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38620178-76de-4e5f-981d-58b148af6345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38620178-76de-4e5f-981d-58b148af6345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d695c0e-ed55-425b-851b-0ee1094f7ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Volume b0de4b15-bf07-4a95-9f98-1dbb51f32383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383', 'volume_size': 1} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1988872212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0de4b15-bf07-4a95-9f98-1dbb51f32383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:12Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Creating volume b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:16:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:11 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 1073741824 Sep 28 16:16:11 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:12 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 1073741824" returned: 0 in 0.965s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:12 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:16:12 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:13 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 0.402s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d695c0e-ed55-425b-851b-0ee1094f7ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781abf27-1ea8-44f7-a5e9-fc4baa4edacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Volume volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 (b0de4b15-bf07-4a95-9f98-1dbb51f32383): created successfully Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (781abf27-1ea8-44f7-a5e9-fc4baa4edacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (69c7a0bd-ac34-4db0-a640-641f2e89e8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9a59ff73-e1bb-46fb-86f1-a0effc7362f2 tempest-VolumesSnapshotTestJSON-89303970 None] Created volume successfully. Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Creating offline snapshot d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 of volume b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7ce73b-468f-4e3b-8fe8-2b1761f9548f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:14 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:16:14 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:14 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 0.604s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:15 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 1G Sep 28 16:16:15 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 1G" returned: 0 in 1.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:16 devstack sudo[98742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:16:16 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:16 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 0.666s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 is being set with open permissions: ugo+rw Sep 28 16:16:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:17 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:16:17 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:17 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:17 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info Sep 28 16:16:17 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:17 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:17 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info is being set with open permissions: ugo+rw Sep 28 16:16:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:17 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info Sep 28 16:16:17 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:18 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.info" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.827s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.088s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-552b1c48-fc92-41d5-aee4-9d4ec6d08be1 tempest-VolumesSnapshotTestJSON-89303970 None] Create snapshot completed successfully Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d331815b-a4c1-4bca-b8fb-428a97476d08]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:18 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:16:18 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:18 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.775s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6350ac-eb2a-416b-9032-8a33dca88f6a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:19 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:16:19 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:19 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (1428b0d9-2369-4c58-b54a-1ccdb80e4307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5efe143-80d6-4c68-a60f-6b72816a7fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.993s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.6b7d20e5-d963-46fa-878d-6d0703b4d6dccxpyfs4f.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:20 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.6b7d20e5-d963-46fa-878d-6d0703b4d6dccxpyfs4f.img Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5efe143-80d6-4c68-a60f-6b72816a7fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-451840940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31173d2-c84f-4f44-9a15-385bcda20ee4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b84d1f4beec47798e426bf6fb0b6535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d73d3489-ecd5-4b00-bfe2-e5fd3684dae5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:20Z,use_quota=True,user_id='82055a88ffb04a06926d448ee8254316',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ecfd1-6b92-42dd-af80-96090e70e1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9ecfd1-6b92-42dd-af80-96090e70e1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca91ce2-6730-47c5-a612-b510fe18ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca91ce2-6730-47c5-a612-b510fe18ce22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b31173d2-c84f-4f44-9a15-385bcda20ee4', 'volume_name': 'volume-b31173d2-c84f-4f44-9a15-385bcda20ee4', 'volume_size': 1, 'snapshot_id': 'd73d3489-ecd5-4b00-bfe2-e5fd3684dae5'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e9f1c7-190e-4eda-9740-b3b2f7a9f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e9f1c7-190e-4eda-9740-b3b2f7a9f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc9819-62d7-4289-aee1-9a2e49a5eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Volume b31173d2-c84f-4f44-9a15-385bcda20ee4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b31173d2-c84f-4f44-9a15-385bcda20ee4', 'volume_size': 1, 'snapshot_id': 'd73d3489-ecd5-4b00-bfe2-e5fd3684dae5'} Sep 28 16:16:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:30 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=82,cinder:UPDATE=81,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:30 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=44,cinder:UPDATE=41,cinder:DELETE=3,cinder:INSERT=10 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:30 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.6b7d20e5-d963-46fa-878d-6d0703b4d6dccxpyfs4f.img" returned: 0 in 10.978s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239777c-03af-494e-9660-8673706e2e51]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:31 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:16:31 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:31 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.741s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:31 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da, size 1024.00 MB, duration 10.98 sec, destination /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.6b7d20e5-d963-46fa-878d-6d0703b4d6dccxpyfs4f.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:16:31 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Converted 1024.00 MB image at 93.27 MB/s Sep 28 16:16:31 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] 6b7d20e5-d963-46fa-878d-6d0703b4d6dc was raw, no need to convert to raw {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:36 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:16:36 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:36 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:16:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Flow 'volume_create_manager' (1ba9a16c-5de2-46e3-bec8-4e5b9deffd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aff92e2-1ffb-40d4-84e5-7cfee7e4ef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aff92e2-1ffb-40d4-84e5-7cfee7e4ef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204100820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37001965-ac22-4433-b9f4-b3a9777db6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18bffdd72724855adecdba6bf3c0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:39Z,use_quota=True,user_id='461f3df462374eb899295934c65d6e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216ec1a3-bb94-4c79-9ef1-e01c6a4d4656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (216ec1a3-bb94-4c79-9ef1-e01c6a4d4656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ff72f6-f089-4978-b8c9-0529f2987bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53ff72f6-f089-4978-b8c9-0529f2987bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37001965-ac22-4433-b9f4-b3a9777db6ad', 'volume_name': 'volume-37001965-ac22-4433-b9f4-b3a9777db6ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55392db0-b5d5-4f93-bfea-65ea67ed95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55392db0-b5d5-4f93-bfea-65ea67ed95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dde1c7-63ce-4112-ab13-105876430246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:16:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume 37001965-ac22-4433-b9f4-b3a9777db6ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37001965-ac22-4433-b9f4-b3a9777db6ad', 'volume_size': 1} Sep 28 16:16:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:41 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:16:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-54f86de0-8e6e-4ae9-b6bd-2fe3175931db req-21637acf-efe2-4ecb-bcad-5d862b87cb0c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.868s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Uploaded volume to glance image-id: 6b7d20e5-d963-46fa-878d-6d0703b4d6dc. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 34.877s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-b31173d2-c84f-4f44-9a15-385bcda20ee4" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-b31173d2-c84f-4f44-9a15-385bcda20ee4" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Creating volume b31173d2-c84f-4f44-9a15-385bcda20ee4 from snapshot d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:16:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9a4eaed7-0685-4b38-a4eb-b5f4ab2a6e6d tempest-VolumesActionsTest-1495633281 None] Copy volume to image completed successfully. Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] snapshot: d73d3489-ecd5-4b00-bfe2-e5fd3684dae5, volume: b31173d2-c84f-4f44-9a15-385bcda20ee4, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d0ddbe-5742-417a-933f-20ee71ac0828]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:55 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:16:55 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:55 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f1894f-4737-4c35-ba21-a031f440f343]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:16:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:55 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:16:55 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:56 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 0.549s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:16:56 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 Sep 28 16:16:56 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:16:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:04 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4" returned: 0 in 8.608s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:04 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:17:04 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Converted 1024.00 MB image at 118.94 MB/s Sep 28 16:17:04 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 is being set with open permissions: ugo+rw Sep 28 16:17:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:04 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 Sep 28 16:17:04 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:05 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" released by "_copy_volume_from_snapshot" :: held 10.146s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-b31173d2-c84f-4f44-9a15-385bcda20ee4" released by "_create_volume_from_snapshot" :: held 10.238s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.266s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.327s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1204100820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37001965-ac22-4433-b9f4-b3a9777db6ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18bffdd72724855adecdba6bf3c0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:16:39Z,use_quota=True,user_id='461f3df462374eb899295934c65d6e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Creating volume 37001965-ac22-4433-b9f4-b3a9777db6ad {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:05 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:05 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad 1073741824 Sep 28 16:17:05 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62bc9819-62d7-4289-aee1-9a2e49a5eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31173d2-c84f-4f44-9a15-385bcda20ee4', 'volume_size': 1, 'snapshot_id': 'd73d3489-ecd5-4b00-bfe2-e5fd3684dae5'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932cc08-00d6-4858-86d7-29ebd325665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Volume volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 (b31173d2-c84f-4f44-9a15-385bcda20ee4): created successfully Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1932cc08-00d6-4858-86d7-29ebd325665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Flow 'volume_create_manager' (1428b0d9-2369-4c58-b54a-1ccdb80e4307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1ea036a8-c139-4fea-b1ae-3f62409c6343 tempest-VolumesSnapshotTestJSON-89303970 None] Created volume successfully. Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-b31173d2-c84f-4f44-9a15-385bcda20ee4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-b31173d2-c84f-4f44-9a15-385bcda20ee4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3361f67-17f4-46c4-8783-10f0560a2a2f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:06 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad 1073741824" returned: 0 in 0.710s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:06 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 Sep 28 16:17:06 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:06 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad Sep 28 16:17:06 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:06 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:06 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4 Sep 28 16:17:06 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:06 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] <== create_volume: return (1193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-54f86de0-8e6e-4ae9-b6bd-2fe3175931db req-21637acf-efe2-4ecb-bcad-5d862b87cb0c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.893s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4dde1c7-63ce-4112-ab13-105876430246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37001965-ac22-4433-b9f4-b3a9777db6ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4e3efd-551b-4302-8ce6-aa924e029934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-54f86de0-8e6e-4ae9-b6bd-2fe3175931db req-21637acf-efe2-4ecb-bcad-5d862b87cb0c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 9.709s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume volume-37001965-ac22-4433-b9f4-b3a9777db6ad (37001965-ac22-4433-b9f4-b3a9777db6ad): created successfully Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4e3efd-551b-4302-8ce6-aa924e029934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Flow 'volume_create_manager' (1ba9a16c-5de2-46e3-bec8-4e5b9deffd90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bfdf24-7318-4ec5-938f-169f624955b5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2059a3e8-e282-4a5e-9946-790b9fb2bcde tempest-VolumeQuotasAdminTestJSON-2074910318 None] Created volume successfully. Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-54f86de0-8e6e-4ae9-b6bd-2fe3175931db req-21637acf-efe2-4ecb-bcad-5d862b87cb0c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-950bfee8-987a-4160-b9f7-37e9cabedccc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3744c780-d322-4238-a5d3-0d415c6758bc', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:17:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-54f86de0-8e6e-4ae9-b6bd-2fe3175931db req-21637acf-efe2-4ecb-bcad-5d862b87cb0c tempest-TestServerVolumeAttachmentScenario-1703243307 None] attachment_update completed successfully. Sep 28 16:17:06 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:17:06 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:06 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b31173d2-c84f-4f44-9a15-385bcda20ee4" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b31173d2-c84f-4f44-9a15-385bcda20ee4" released by "delete_volume" :: held 1.018s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['c849f1a9-c5f0-44cc-85d2-436251d90539', '695d92fb-06c2-4316-9918-9e185c2cd201', '508b9e4c-9cd6-4c2b-a795-48960e052270', '5dd02bd3-f06f-482a-886a-02d85211972b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:07 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.592s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:07 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:07 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc45b4d0-847d-4ee4-8a5e-4de938596462]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:07 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:17:07 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:07 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Deleted volume successfully. Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f771af95-8f2a-4127-8d66-51815eb8367a tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-b31173d2-c84f-4f44-9a15-385bcda20ee4-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:07 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.551s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:07 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img Sep 28 16:17:07 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "cinder-37001965-ac22-4433-b9f4-b3a9777db6ad-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "cinder-37001965-ac22-4433-b9f4-b3a9777db6ad-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "cinder-quobyte-37001965-ac22-4433-b9f4-b3a9777db6ad" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "cinder-quobyte-37001965-ac22-4433-b9f4-b3a9777db6ad" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5017eb45-a8fd-4126-929c-40a183d7dd84]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:08 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad Sep 28 16:17:08 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Deleting offline snapshot d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 of volume b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] snapshot_file for this snap is: volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018e469-51ea-4406-9fb8-81329021dce0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:08 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:17:08 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:09 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad" returned: 0 in 1.176s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:09 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad Sep 28 16:17:09 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:09 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 1.119s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[17211651-f857-4623-a97a-26af84fa0625]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:10 devstack sudo[99439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:17:10 devstack sudo[99439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:10 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-37001965-ac22-4433-b9f4-b3a9777db6ad" returned: 0 in 0.877s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "cinder-quobyte-37001965-ac22-4433-b9f4-b3a9777db6ad" released by "delete_volume" :: held 2.163s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Created reservations ['d74c5601-786c-42e3-bf0e-a58153e423d9', 'd2db4f97-8383-4eec-9e1d-07194ad42332', 'd223ec07-085b-439e-b007-13aeaf21ae2b', 'db64e2a1-0877-4fa1-b065-dc41587a5dc5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:10 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:10 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:11 devstack sudo[99439]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 1.591s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:11 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:17:11 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:11 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.858s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Deleted volume successfully. Sep 28 16:17:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5b47842c-9100-4ad9-a1f8-897d29316add tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "cinder-37001965-ac22-4433-b9f4-b3a9777db6ad-delete_volume" released by "delete_volume" :: held 3.913s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:12 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 1.186s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:12 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5 Sep 28 16:17:12 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Flow 'volume_create_manager' (099ed735-7f45-4434-ae37-c6e9f93058b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f280e2-871b-4280-bf48-c9b754735dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f280e2-871b-4280-bf48-c9b754735dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1525063044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b4dbd8-27df-430a-a822-1526c0390baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18bffdd72724855adecdba6bf3c0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:13Z,use_quota=True,user_id='461f3df462374eb899295934c65d6e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0c1fb-7df5-40c3-95b1-dcc7182e55fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e0c1fb-7df5-40c3-95b1-dcc7182e55fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b5bf31-0ee0-4a3a-9a55-c9dda3e887fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b5bf31-0ee0-4a3a-9a55-c9dda3e887fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b4dbd8-27df-430a-a822-1526c0390baa', 'volume_name': 'volume-36b4dbd8-27df-430a-a822-1526c0390baa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d66a59-16ba-437d-ac67-7852d1814aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d66a59-16ba-437d-ac67-7852d1814aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:13 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51150cf-9f1f-4be3-b025-0ce372d619e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume 36b4dbd8-27df-430a-a822-1526c0390baa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b4dbd8-27df-430a-a822-1526c0390baa', 'volume_size': 1} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383.d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" returned: 0 in 0.836s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5" released by "_delete_snapshot" :: held 5.110s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" released by "delete_snapshot" :: held 5.190s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['589d6b8b-3393-40e4-a54e-a3b5d8ee960f', 'cfcccefe-2838-4442-9039-e4fadcb14dbf', '96c642cf-c710-41e4-81ad-ebec36f20a42', '0e8d3355-404f-4560-98fa-365d57a16bdf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Delete snapshot completed successfully. Sep 28 16:17:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1d921dc0-4ea3-4e91-8683-de6c1f176bdd tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-d73d3489-ecd5-4b00-bfe2-e5fd3684dae5-delete_snapshot" released by "delete_snapshot" :: held 5.638s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-b0de4b15-bf07-4a95-9f98-1dbb51f32383-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-b0de4b15-bf07-4a95-9f98-1dbb51f32383-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[51db9837-2e5a-4725-92e5-a80b1cab7684]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:14 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:17:14 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:15 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 0.768s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:15 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383 Sep 28 16:17:15 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:16 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b0de4b15-bf07-4a95-9f98-1dbb51f32383" returned: 0 in 0.594s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-b0de4b15-bf07-4a95-9f98-1dbb51f32383" released by "delete_volume" :: held 1.564s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['40eb10e5-8491-43ed-aa6a-3d266a205f2b', '9cf0a9c2-d848-4384-8692-52ff4b709445', '698d2d7b-6fdc-41de-a5a8-8eb55e7dcd3a', 'd6f63cdc-3133-4464-8b66-d5356352a497'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:16 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:16 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:17 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.671s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Deleted volume successfully. Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af9d9ee5-81ff-4215-a977-d65048b9c5f2 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-b0de4b15-bf07-4a95-9f98-1dbb51f32383-delete_volume" released by "delete_volume" :: held 2.755s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-c887befe-923a-45d9-8b0d-5116a8c1c3b8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-c887befe-923a-45d9-8b0d-5116a8c1c3b8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e4354e-678e-416c-aaef-ced1c2e5e159]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3601f7b4-b47b-4bf6-9d73-913b749fb864 req-f63bf6cd-afc8-4ce9-92b0-e35213eaa370 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:18 devstack sudo[99479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 Sep 28 16:17:18 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img" returned: 0 in 10.737s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[751d727f-4582-4381-b382-c0139eb9c615]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:18 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8" returned: 0 in 0.924s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:18 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8 Sep 28 16:17:18 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:17:18 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:18 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c887befe-923a-45d9-8b0d-5116a8c1c3b8" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-quobyte-c887befe-923a-45d9-8b0d-5116a8c1c3b8" released by "delete_volume" :: held 1.381s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Created reservations ['ef938b59-9fe1-49a1-a5d9-15378e7495cd', '2d7d2498-98c3-4524-aa93-5cf9de6a2550', '3118301f-d44d-4dea-8f38-69cdeddf9c6a', '96e9bb81-aaca-4eb9-93f1-26cee3d5a450'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:19 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:19 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:19 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.743s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:17:19 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Converted 1024.00 MB image at 95.37 MB/s Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] 7fff6b5e-3454-495b-8af8-fecce45babe2 was raw, converting to qcow2 {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8865831-b379-43b3-8e91-5a4c1e9a43f2]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:19 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Deleted volume successfully. Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e5ff106d-765d-48b3-a65e-8b92d419e3a0 tempest-VolumesSnapshotTestJSON-89303970 None] Lock "cinder-c887befe-923a-45d9-8b0d-5116a8c1c3b8-delete_volume" released by "delete_volume" :: held 2.044s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:19 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img Sep 28 16:17:19 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:19 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:19 devstack sudo[99499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img Sep 28 16:17:19 devstack sudo[99499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:20 devstack sudo[99499]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img" returned: 1 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:20 devstack sudo[99504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux Sep 28 16:17:20 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:20 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux" returned: 0 in 0.312s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Image conversion details: src /opt/stack/data/cinder/conversion/1a7b06ca-d632-4a93-9da8-08dacf9352da.temp_image.7fff6b5e-3454-495b-8af8-fecce45babe22qm64z96.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:17:20 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[137b2c54-3894-4bae-a1d3-4dc1d6d6381b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:20 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux Sep 28 16:17:20 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:20 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3hpor5ux" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.334s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Uploaded volume to glance image-id: 7fff6b5e-3454-495b-8af8-fecce45babe2. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.520s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1525063044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b4dbd8-27df-430a-a822-1526c0390baa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e18bffdd72724855adecdba6bf3c0c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:13Z,use_quota=True,user_id='461f3df462374eb899295934c65d6e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Creating volume 36b4dbd8-27df-430a-a822-1526c0390baa {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:22 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:17:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5d0e1c71-eb1d-4925-a27f-d6e0bb6bcc69 tempest-VolumesActionsTest-1495633281 None] Copy volume to image completed successfully. Sep 28 16:17:22 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa 1073741824 Sep 28 16:17:22 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:23 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa 1073741824" returned: 0 in 0.722s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:23 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa Sep 28 16:17:23 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:24 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3601f7b4-b47b-4bf6-9d73-913b749fb864 req-f63bf6cd-afc8-4ce9-92b0-e35213eaa370 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.370s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f51150cf-9f1f-4be3-b025-0ce372d619e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b4dbd8-27df-430a-a822-1526c0390baa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907a04ac-1ccc-4962-9550-32a666325d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3601f7b4-b47b-4bf6-9d73-913b749fb864 req-f63bf6cd-afc8-4ce9-92b0-e35213eaa370 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Volume volume-36b4dbd8-27df-430a-a822-1526c0390baa (36b4dbd8-27df-430a-a822-1526c0390baa): created successfully Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907a04ac-1ccc-4962-9550-32a666325d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Flow 'volume_create_manager' (099ed735-7f45-4434-ae37-c6e9f93058b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c4263454-a6d9-4d97-bde4-a1e3a0baa7a8 tempest-VolumeQuotasAdminTestJSON-2074910318 None] Created volume successfully. Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-3601f7b4-b47b-4bf6-9d73-913b749fb864 req-f63bf6cd-afc8-4ce9-92b0-e35213eaa370 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-0061754c-b7c8-411f-beda-2cf115a76e41', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e38dab64-465f-4017-8ee0-23bb8285c8a1', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:17:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-3601f7b4-b47b-4bf6-9d73-913b749fb864 req-f63bf6cd-afc8-4ce9-92b0-e35213eaa370 tempest-TestServerVolumeAttachmentScenario-1703243307 None] attachment_update completed successfully. Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "cinder-quobyte-1a7b06ca-d632-4a93-9da8-08dacf9352da" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-quobyte-1a7b06ca-d632-4a93-9da8-08dacf9352da" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[09954277-a381-4bb3-9c62-e8a1131bb0ac]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:25 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:17:25 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:25 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.637s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:25 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da Sep 28 16:17:25 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e683477f-b953-4d67-bdbb-04817d96be7d tempest-VolumeQuotasAdminTestJSON-995533390 None] Transfer volume completed successfully. Sep 28 16:17:26 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a7b06ca-d632-4a93-9da8-08dacf9352da" returned: 0 in 0.575s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-quobyte-1a7b06ca-d632-4a93-9da8-08dacf9352da" released by "delete_volume" :: held 1.343s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Created reservations ['4b19eb80-9356-4ae6-a73a-1863f99f45ca', '2f639f7a-ec0a-4407-bafc-2d98d63e8f95', '7c3aa1e9-b754-456c-ab93-374345a804fb', 'ea0de28d-d4fb-4973-809f-406286a3333c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:26 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:26 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:27 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Deleted volume successfully. Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b978b87b-1007-428b-ab14-cdf8ef3da206 tempest-VolumesActionsTest-1495633281 None] Lock "cinder-1a7b06ca-d632-4a93-9da8-08dacf9352da-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Acquiring lock "cinder-36b4dbd8-27df-430a-a822-1526c0390baa-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "cinder-36b4dbd8-27df-430a-a822-1526c0390baa-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Acquiring lock "cinder-quobyte-36b4dbd8-27df-430a-a822-1526c0390baa" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "cinder-quobyte-36b4dbd8-27df-430a-a822-1526c0390baa" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bcc59d-f54c-401b-a7f9-df4e4eb089d5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:27 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa Sep 28 16:17:27 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-b4e68ff6-cb27-4302-9e8b-920d45b9f42a req-4c12192b-75be-46a7-a3dc-1ec4cba7dc46 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Terminate volume connection completed successfully. Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-b4e68ff6-cb27-4302-9e8b-920d45b9f42a req-4c12192b-75be-46a7-a3dc-1ec4cba7dc46 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Deleting attachment e38dab64-465f-4017-8ee0-23bb8285c8a1. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:17:28 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:28 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa Sep 28 16:17:28 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:28 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-36b4dbd8-27df-430a-a822-1526c0390baa" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "cinder-quobyte-36b4dbd8-27df-430a-a822-1526c0390baa" released by "delete_volume" :: held 1.099s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:28 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Created reservations ['89eb4f67-c52b-4c21-b29e-4966ee873b3d', '25b733fe-64a9-42ee-976f-efbbb7dc3912', 'af5bd9c3-bfcc-4f59-b445-bb911007241f', '53f5f9c9-1798-4806-9224-b6f3d3571105'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:29 devstack sudo[99582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:29 devstack sudo[99582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:29 devstack sudo[99582]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Deleted volume successfully. Sep 28 16:17:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ceaa445f-31b0-49ab-8741-9c1f7d6b369f tempest-VolumeQuotasAdminTestJSON-403442040 None] Lock "cinder-36b4dbd8-27df-430a-a822-1526c0390baa-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:31 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=61,cinder:UPDATE=68,cinder:INSERT=16,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-cfa5b5a9-ee63-493d-a72b-016899ba446b req-871ee2ff-5ee4-4f5f-bb0e-8af97307fb6c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Terminate volume connection completed successfully. Sep 28 16:17:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-cfa5b5a9-ee63-493d-a72b-016899ba446b req-871ee2ff-5ee4-4f5f-bb0e-8af97307fb6c tempest-TestServerVolumeAttachmentScenario-1703243307 None] Deleting attachment 3744c780-d322-4238-a5d3-0d415c6758bc. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Flow 'volume_create_manager' (3a6e505c-5e69-4a25-b248-3f08d72e5e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba81f613-3426-4019-8b9c-da9ae24c8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba81f613-3426-4019-8b9c-da9ae24c8b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-601016381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e7027c-a01a-463e-aef0-ad1887e64ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f480fce48044268a3a2ff52a3cf961b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:34Z,use_quota=True,user_id='9690260ebbb04a5fa5b07d299f199b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a64f2b9-8be3-4ef4-8371-8705de54ca96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a64f2b9-8be3-4ef4-8371-8705de54ca96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0857fcdb-c707-449e-b31f-ad1ec2c176db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0857fcdb-c707-449e-b31f-ad1ec2c176db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98e7027c-a01a-463e-aef0-ad1887e64ae1', 'volume_name': 'volume-98e7027c-a01a-463e-aef0-ad1887e64ae1', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19f4bb1-8c3c-403d-aafa-a7bb90f35f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a19f4bb1-8c3c-403d-aafa-a7bb90f35f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b297cdc-a1d3-49c1-be5a-d93a2166428c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Volume 98e7027c-a01a-463e-aef0-ad1887e64ae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98e7027c-a01a-463e-aef0-ad1887e64ae1', 'volume_size': 2} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:17:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-601016381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98e7027c-a01a-463e-aef0-ad1887e64ae1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f480fce48044268a3a2ff52a3cf961b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:17:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:17:34Z,use_quota=True,user_id='9690260ebbb04a5fa5b07d299f199b62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Creating volume 98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:17:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:17:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 2147483648 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:34 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 2147483648 Sep 28 16:17:34 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:35 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 2147483648" returned: 0 in 0.960s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:35 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 Sep 28 16:17:35 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:36 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b297cdc-a1d3-49c1-be5a-d93a2166428c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98e7027c-a01a-463e-aef0-ad1887e64ae1', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5cbf7e-cda8-48a2-9703-284a8423ffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:17:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Volume volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 (98e7027c-a01a-463e-aef0-ad1887e64ae1): created successfully Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa5cbf7e-cda8-48a2-9703-284a8423ffc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Flow 'volume_create_manager' (3a6e505c-5e69-4a25-b248-3f08d72e5e15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:17:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-adcb389e-c883-425f-a827-c05a9b885f14 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Created volume successfully. Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:36 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:36 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:37 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.642s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Creating offline snapshot 570e9216-06c3-4033-9bed-b12c732493f0 of volume 98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c825c2df-2973-45de-b9cb-4941f3faae71]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:37 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 Sep 28 16:17:37 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:38 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1" returned: 0 in 0.838s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 2G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:38 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 2G Sep 28 16:17:38 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:38 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 2G" returned: 0 in 0.774s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:39 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 Sep 28 16:17:39 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:39 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0" returned: 0 in 0.484s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:39 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 is being set with open permissions: ugo+rw Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:39 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 Sep 28 16:17:39 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "cinder-0061754c-b7c8-411f-beda-2cf115a76e41-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-0061754c-b7c8-411f-beda-2cf115a76e41-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:39 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0" returned: 0 in 0.479s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "cinder-quobyte-0061754c-b7c8-411f-beda-2cf115a76e41" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-quobyte-0061754c-b7c8-411f-beda-2cf115a76e41" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b30562-e57f-4ff3-8b00-687960da99d8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:40 devstack sudo[99654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info Sep 28 16:17:40 devstack sudo[99654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:40 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 Sep 28 16:17:40 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:40 devstack sudo[99654]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info" returned: 0 in 0.498s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:40 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info is being set with open permissions: ugo+rw Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:40 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info Sep 28 16:17:40 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:40 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41" returned: 0 in 0.603s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:40 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41 Sep 28 16:17:40 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:41 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.info" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.858s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:41 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0061754c-b7c8-411f-beda-2cf115a76e41" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-quobyte-0061754c-b7c8-411f-beda-2cf115a76e41" released by "delete_volume" :: held 1.155s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-26739532-6cdd-4e66-98e9-e49b144866a8 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Create snapshot completed successfully Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Created reservations ['76e235e8-0e41-48d2-b5d3-592785f57a22', 'f647fcf2-c9fa-4042-84d9-bee9b23e23d0', '0b32ac53-5e9e-4c99-9d0e-b2624b20ba7c', '9f53ca0b-2457-4297-85db-92dd006e4242'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:41 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:41 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "cinder-570e9216-06c3-4033-9bed-b12c732493f0-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-570e9216-06c3-4033-9bed-b12c732493f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "cinder-quobyte-570e9216-06c3-4033-9bed-b12c732493f0" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-570e9216-06c3-4033-9bed-b12c732493f0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Deleting offline snapshot 570e9216-06c3-4033-9bed-b12c732493f0 of volume 98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] snapshot_file for this snap is: volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c54d840-544b-4fc7-86df-af66d045b38b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:41 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.487s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Deleted volume successfully. Sep 28 16:17:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9d6336be-0288-42e6-bd55-b175f9c81f70 tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-0061754c-b7c8-411f-beda-2cf115a76e41-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:42 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 Sep 28 16:17:42 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "cinder-950bfee8-987a-4160-b9f7-37e9cabedccc-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-950bfee8-987a-4160-b9f7-37e9cabedccc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "cinder-quobyte-950bfee8-987a-4160-b9f7-37e9cabedccc" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-quobyte-950bfee8-987a-4160-b9f7-37e9cabedccc" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0ab7b8-6a36-41a3-bd6a-267927820d3c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:42 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0" returned: 0 in 0.694s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98e7027c-a01a-463e-aef0-ad1887e64ae1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:17:42 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc Sep 28 16:17:42 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5e462-730b-420b-ba32-ce7efccf1c65]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:42 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 Sep 28 16:17:42 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:43 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc" returned: 0 in 0.620s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:43 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc Sep 28 16:17:43 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:43 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1" returned: 0 in 0.585s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:43 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 Sep 28 16:17:43 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:43 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-950bfee8-987a-4160-b9f7-37e9cabedccc" returned: 0 in 0.557s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-quobyte-950bfee8-987a-4160-b9f7-37e9cabedccc" released by "delete_volume" :: held 1.246s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Created reservations ['d5c51f26-eaa3-4b75-98d2-52563a3a4465', 'a0a7eca6-ef25-45e7-9a9a-33029616b1b9', '95947390-525d-4b7d-adde-d2ee7eca0801', 'ab6da479-f2b9-4766-a5c9-00fef7d25ff8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:43 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0" returned: 0 in 0.545s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:43 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0 Sep 28 16:17:43 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:43 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:43 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:44 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1.570e9216-06c3-4033-9bed-b12c732493f0" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-570e9216-06c3-4033-9bed-b12c732493f0" released by "_delete_snapshot" :: held 2.460s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" released by "delete_snapshot" :: held 2.498s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:44 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Deleted volume successfully. Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b5e3f7a4-9805-4eb0-bd79-869ba35cb2eb tempest-TestServerVolumeAttachmentScenario-1703243307 None] Lock "cinder-950bfee8-987a-4160-b9f7-37e9cabedccc-delete_volume" released by "delete_volume" :: held 2.077s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Created reservations ['8bb4bee9-52ea-47e1-a12f-7e5eb7907972', '736cbf9d-b5b2-4f01-8b4e-d2e53c9663ae', '7ed63f6c-87bd-40ef-b734-df4fd194278a', 'f6c2bd23-0554-4e8c-b4bf-495d4de33901'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Delete snapshot completed successfully. Sep 28 16:17:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa6193b4-b7ab-423c-876b-7d13b9a84224 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-570e9216-06c3-4033-9bed-b12c732493f0-delete_snapshot" released by "delete_snapshot" :: held 2.801s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "cinder-98e7027c-a01a-463e-aef0-ad1887e64ae1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-98e7027c-a01a-463e-aef0-ad1887e64ae1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53346bd-eb3a-4d44-9345-b07faecc3a9f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:17:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:45 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 Sep 28 16:17:45 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:46 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1" returned: 0 in 0.711s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:46 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1 Sep 28 16:17:46 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:46 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-98e7027c-a01a-463e-aef0-ad1887e64ae1" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-quobyte-98e7027c-a01a-463e-aef0-ad1887e64ae1" released by "delete_volume" :: held 1.366s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Created reservations ['e5105c86-dd29-4ccd-9c9b-4e9840cb4a75', '4bab6ffb-983c-4fab-b7b2-7042c410cd63', '692e6fa3-ccad-4992-b523-d10ad1276b6f', 'de67bc89-2db1-4215-921b-af861d452fa4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:17:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:17:46 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:17:46 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:17:47 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 28 16:17:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:17:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:17:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Deleted volume successfully. Sep 28 16:17:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d4e03b2c-6a49-4ba4-9ae1-d1269b920858 tempest-VolumesSnapshotNegativeTestJSON-1278107612 None] Lock "cinder-98e7027c-a01a-463e-aef0-ad1887e64ae1-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:17:56 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=29,cinder:UPDATE=33,cinder:INSERT=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:17:57 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=81,cinder:UPDATE=99,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (297643b1-3b71-475d-b21c-c912359202f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5970187a-ea91-4def-909e-5ce520873ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5970187a-ea91-4def-909e-5ce520873ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-400071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7431c7b-a5ff-4bd1-a8ca-e51533b25728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:00Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb5381-16c2-4b77-b3d6-da3bdf3d7523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2fb5381-16c2-4b77-b3d6-da3bdf3d7523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea666ac-e22b-40eb-911d-2628f92ed521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea666ac-e22b-40eb-911d-2628f92ed521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7431c7b-a5ff-4bd1-a8ca-e51533b25728', 'volume_name': 'volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617e750e-a114-4d86-ae51-313ed85821b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617e750e-a114-4d86-ae51-313ed85821b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731571e6-b820-419d-966f-09e1bc462b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:00 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Volume b7431c7b-a5ff-4bd1-a8ca-e51533b25728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728', 'volume_size': 1} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-400071823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7431c7b-a5ff-4bd1-a8ca-e51533b25728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:00Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Creating volume b7431c7b-a5ff-4bd1-a8ca-e51533b25728 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:00 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:00 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 1073741824 Sep 28 16:18:00 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:01 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 1073741824" returned: 0 in 0.975s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:01 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 Sep 28 16:18:01 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:02 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.629s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (731571e6-b820-419d-966f-09e1bc462b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428cbf9d-348b-4ccb-9294-93e737ae915f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Volume volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 (b7431c7b-a5ff-4bd1-a8ca-e51533b25728): created successfully Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428cbf9d-348b-4ccb-9294-93e737ae915f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (297643b1-3b71-475d-b21c-c912359202f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-478ac1b0-f8e0-40da-9239-e58a9b97e7b1 tempest-VolumesListAdminTestJSON-1884688211 None] Created volume successfully. Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (27d96670-2ced-4999-a8f7-ae58028e2d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161247e-3988-40de-9115-3279d75f2bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9161247e-3988-40de-9115-3279d75f2bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2003626311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b7e2ef-91c1-499a-a606-71b8998f0b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:04Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348ade4f-dfd0-47a3-a628-f81ce0653489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (348ade4f-dfd0-47a3-a628-f81ce0653489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076ffac8-8526-4a7b-a4c3-2aea2450fef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (076ffac8-8526-4a7b-a4c3-2aea2450fef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1b7e2ef-91c1-499a-a606-71b8998f0b77', 'volume_name': 'volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef9842d-172b-4b06-a6b9-283fb1c0d96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ef9842d-172b-4b06-a6b9-283fb1c0d96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1a4f72-1cec-4e82-87cf-fd7f70b9920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Volume f1b7e2ef-91c1-499a-a606-71b8998f0b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77', 'volume_size': 1} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2003626311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1b7e2ef-91c1-499a-a606-71b8998f0b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:04Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Creating volume f1b7e2ef-91c1-499a-a606-71b8998f0b77 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:04 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:04 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 1073741824 Sep 28 16:18:04 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Flow 'volume_create_manager' (24dc97e1-1450-4e90-b01c-752b2a99a165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54574a4d-9a4c-493e-843e-e3a0d7476b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54574a4d-9a4c-493e-843e-e3a0d7476b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f4bb57-6d89-45dc-ad83-5189b64005a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217961c0772a43cb96a866fc56579aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:04Z,use_quota=True,user_id='8cdb72d800a849439f8102e940284598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(887cc8f9-00b3-4fd1-b973-7e1e705e5d3c),volume_type_id=887cc8f9-00b3-4fd1-b973-7e1e705e5d3c)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d26b8fe-c9fc-4fee-bcf1-6e30eeed437e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d26b8fe-c9fc-4fee-bcf1-6e30eeed437e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554bcb3-6f28-4730-b211-bb57b9f52abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:04 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:18:05 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 1073741824" returned: 0 in 0.885s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:05 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 Sep 28 16:18:05 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2554bcb3-6f28-4730-b211-bb57b9f52abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2f4bb57-6d89-45dc-ad83-5189b64005a4', 'volume_name': 'volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4', 'volume_size': 1, 'image_id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '166761b51b20e6a8a6022712ff90cc2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '217961c0772a43cb96a866fc56579aa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd684089462d47c1f87e14c0562c39c2a104fd32072619040f33a771f254247239bd2057a6c3dd8c74de17194baced731dc394723567ec855084744d6cdaef431', 'id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'created_at': datetime.datetime(2026, 9, 28, 14, 17, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0de21c1a-7019-423d-9728-b8ff4184162a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7bb25d-81cb-4402-86bf-bccf0009c157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e7bb25d-81cb-4402-86bf-bccf0009c157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38caac4-03b3-4753-8330-4c476e5167a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Volume a2f4bb57-6d89-45dc-ad83-5189b64005a4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4', 'volume_size': 1, 'image_id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '166761b51b20e6a8a6022712ff90cc2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '217961c0772a43cb96a866fc56579aa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd684089462d47c1f87e14c0562c39c2a104fd32072619040f33a771f254247239bd2057a6c3dd8c74de17194baced731dc394723567ec855084744d6cdaef431', 'id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'created_at': datetime.datetime(2026, 9, 28, 14, 17, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0de21c1a-7019-423d-9728-b8ff4184162a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Trying to clone a2f4bb57-6d89-45dc-ad83-5189b64005a4 from image 0de21c1a-7019-423d-9728-b8ff4184162a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:18:05 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77" returned: 0 in 0.479s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] <== create_volume: return (1436ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1a4f72-1cec-4e82-87cf-fd7f70b9920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d22d204-d629-4037-9b19-68189e39ed34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Volume volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 (f1b7e2ef-91c1-499a-a606-71b8998f0b77): created successfully Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d22d204-d629-4037-9b19-68189e39ed34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (27d96670-2ced-4999-a8f7-ae58028e2d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-78ea3c64-522b-49ea-b835-2800fe1a7463 tempest-VolumesListAdminTestJSON-1884688211 None] Created volume successfully. Sep 28 16:18:06 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:18:06 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:18:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd25f5a-d9ae-474c-b818-e7cc7278d095]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:06 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:06 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:06 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 0 in 0.548s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:06 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:06 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:07 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 1 in 0.698s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Temporary image 0de21c1a-7019-423d-9728-b8ff4184162a is fetched for user 8cdb72d800a849439f8102e940284598. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7560d3e-64a4-4070-a317-63427b087ae2]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (358bd43b-c489-42bd-9a3f-60e5b9f9c5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54a763-2774-4e26-9a25-48dad3cd2fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c54a763-2774-4e26-9a25-48dad3cd2fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1112010638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d053f76-a4dd-4096-aed6-dfd8e8741927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:07Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12913e71-aac6-4084-9d1b-494eaf935a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12913e71-aac6-4084-9d1b-494eaf935a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51418719-c564-41f0-8950-f32fbe314cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51418719-c564-41f0-8950-f32fbe314cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d053f76-a4dd-4096-aed6-dfd8e8741927', 'volume_name': 'volume-8d053f76-a4dd-4096-aed6-dfd8e8741927', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b44fcc0-3268-4d40-aa7b-7c87c43e18fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b44fcc0-3268-4d40-aa7b-7c87c43e18fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536f5806-78be-489c-8f0d-5e407fb7a7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:07 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Volume 8d053f76-a4dd-4096-aed6-dfd8e8741927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d053f76-a4dd-4096-aed6-dfd8e8741927', 'volume_size': 1} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1112010638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d053f76-a4dd-4096-aed6-dfd8e8741927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef7bf03d7dd43b79af3e8eb6672f0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:07Z,use_quota=True,user_id='071a7ee56af84c83b0b2788b705900b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Creating volume 8d053f76-a4dd-4096-aed6-dfd8e8741927 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:07 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:07 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 1073741824 Sep 28 16:18:07 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:08 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 0 in 0.694s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:08 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:08 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:08 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 1073741824" returned: 0 in 0.764s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:08 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 Sep 28 16:18:08 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:08 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 1 in 0.595s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:08 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927" returned: 0 in 0.457s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.209s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f4bb57-6d89-45dc-ad83-5189b64005a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='217961c0772a43cb96a866fc56579aa7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:04Z,use_quota=True,user_id='8cdb72d800a849439f8102e940284598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(887cc8f9-00b3-4fd1-b973-7e1e705e5d3c),volume_type_id=887cc8f9-00b3-4fd1-b973-7e1e705e5d3c)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Creating volume a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (536f5806-78be-489c-8f0d-5e407fb7a7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d053f76-a4dd-4096-aed6-dfd8e8741927', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83ddeb3-ed23-42a7-af6e-471e1847370e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:09 devstack sudo[99815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1073741824 Sep 28 16:18:09 devstack sudo[99815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Volume volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 (8d053f76-a4dd-4096-aed6-dfd8e8741927): created successfully Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83ddeb3-ed23-42a7-af6e-471e1847370e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Flow 'volume_create_manager' (358bd43b-c489-42bd-9a3f-60e5b9f9c5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b8457985-8b73-4966-9a26-63ef5224e6af tempest-VolumesListAdminTestJSON-1884688211 None] Created volume successfully. Sep 28 16:18:09 devstack sudo[99815]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1073741824" returned: 0 in 0.792s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:09 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 Sep 28 16:18:09 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:10 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Attempting download of 0de21c1a-7019-423d-9728-b8ff4184162a ((None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}])) to volume a2f4bb57-6d89-45dc-ad83-5189b64005a4. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9004fc7b-01dd-4cf1-a9a8-567c3d0510a6]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:10 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388 Sep 28 16:18:10 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:11 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388" returned: 0 in 0.557s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Flow 'volume_create_manager' (d8f16580-3d20-4e18-a9b5-28cf5c5bd4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b80126-fc6f-419f-a1c8-503ecc9a6037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06b80126-fc6f-419f-a1c8-503ecc9a6037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e23f4f-68a9-44f0-a04e-3729b6cefcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6baffd3839c47a783119e8242857d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:11Z,use_quota=True,user_id='82e0073f80df4dcfaf9464e8d9162c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d5d821-3bf3-4ee1-a392-0afcab3d0f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8d5d821-3bf3-4ee1-a392-0afcab3d0f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7109add5-2334-4fee-a3ae-5cdc9e7dc8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7109add5-2334-4fee-a3ae-5cdc9e7dc8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18e23f4f-68a9-44f0-a04e-3729b6cefcb8', 'volume_name': 'volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:11 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388 Sep 28 16:18:11 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ce8ad-c64a-4a72-8744-85ad42b36514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11ce8ad-c64a-4a72-8744-85ad42b36514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8248f07f-c067-4f64-a50d-56c6a8a7c74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Volume 18e23f4f-68a9-44f0-a04e-3729b6cefcb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8', 'volume_size': 1} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18e23f4f-68a9-44f0-a04e-3729b6cefcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6baffd3839c47a783119e8242857d04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:11Z,use_quota=True,user_id='82e0073f80df4dcfaf9464e8d9162c02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Creating volume 18e23f4f-68a9-44f0-a04e-3729b6cefcb8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:11 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:11 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 1073741824 Sep 28 16:18:11 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:11 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388" returned: 1 in 0.561s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0de21c1a-7019-423d-9728-b8ff4184162a_l7z4g388' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef655c45-e486-4303-b893-00a7628bf909]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:11 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:11 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:12 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 1073741824" returned: 0 in 0.899s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:12 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 0 in 0.631s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:12 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD Sep 28 16:18:12 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:12 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8248f07f-c067-4f64-a50d-56c6a8a7c74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5e9a0-c464-4981-9d16-11aafbc97cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Volume volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 (18e23f4f-68a9-44f0-a04e-3729b6cefcb8): created successfully Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04d5e9a0-c464-4981-9d16-11aafbc97cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Flow 'volume_create_manager' (d8f16580-3d20-4e18-a9b5-28cf5c5bd4c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-099ebf8d-948c-463e-8beb-f6e6d7233159 tempest-VolumesListAdminTestJSON-135517271 None] Created volume successfully. Sep 28 16:18:12 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD" returned: 1 in 0.504s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] 0de21c1a-7019-423d-9728-b8ff4184162a was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:18:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:12 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 Sep 28 16:18:12 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Acquiring lock "cinder-18e23f4f-68a9-44f0-a04e-3729b6cefcb8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "cinder-18e23f4f-68a9-44f0-a04e-3729b6cefcb8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Acquiring lock "cinder-quobyte-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "cinder-quobyte-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4" returned: 0 in 0.870s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0de21c1a-7019-423d-9728-b8ff4184162a_qzmcar99devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:18:13 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11bfda5-993a-41f2-b47c-3c2c6a810336]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:13 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1G Sep 28 16:18:13 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-8d053f76-a4dd-4096-aed6-dfd8e8741927-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-8d053f76-a4dd-4096-aed6-dfd8e8741927-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:13 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 Sep 28 16:18:13 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-quobyte-8d053f76-a4dd-4096-aed6-dfd8e8741927" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-8d053f76-a4dd-4096-aed6-dfd8e8741927" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3825b310-ff27-4072-9883-f64f703c017c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:14 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 Sep 28 16:18:14 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:14 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 1G" returned: 0 in 0.682s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Downloaded image 0de21c1a-7019-423d-9728-b8ff4184162a ((None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}])) to volume a2f4bb57-6d89-45dc-ad83-5189b64005a4 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Temporary image 0de21c1a-7019-423d-9728-b8ff4184162a for user 8cdb72d800a849439f8102e940284598 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Marking volume a2f4bb57-6d89-45dc-ad83-5189b64005a4 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Copying metadata from image 0de21c1a-7019-423d-9728-b8ff4184162a to a2f4bb57-6d89-45dc-ad83-5189b64005a4. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Creating volume glance metadata for volume a2f4bb57-6d89-45dc-ad83-5189b64005a4 backed by image 0de21c1a-7019-423d-9728-b8ff4184162a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '166761b51b20e6a8a6022712ff90cc2e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:18:14 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" returned: 0 in 0.749s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:14 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8 Sep 28 16:18:14 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c38caac4-03b3-4753-8330-4c476e5167a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4', 'volume_size': 1, 'image_id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0de21c1a-7019-423d-9728-b8ff4184162a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '166761b51b20e6a8a6022712ff90cc2e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '217961c0772a43cb96a866fc56579aa7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd684089462d47c1f87e14c0562c39c2a104fd32072619040f33a771f254247239bd2057a6c3dd8c74de17194baced731dc394723567ec855084744d6cdaef431', 'id': '0de21c1a-7019-423d-9728-b8ff4184162a', 'created_at': datetime.datetime(2026, 9, 28, 14, 17, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0de21c1a-7019-423d-9728-b8ff4184162a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9aa5db-9722-47ee-8ec6-c0f57b3a01e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Volume volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 (a2f4bb57-6d89-45dc-ad83-5189b64005a4): created successfully Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9aa5db-9722-47ee-8ec6-c0f57b3a01e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Flow 'volume_create_manager' (24dc97e1-1450-4e90-b01c-752b2a99a165) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-109c3aae-7d03-4f03-b59a-3373182fb66b tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Created volume successfully. Sep 28 16:18:14 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927" returned: 0 in 0.752s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:14 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927 Sep 28 16:18:14 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:14 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "cinder-quobyte-18e23f4f-68a9-44f0-a04e-3729b6cefcb8" released by "delete_volume" :: held 1.337s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Created reservations ['aaf41c58-c40d-462b-9f11-fa7b6ca7d724', '64ca0279-5a55-4f4c-a268-c9e565e2bb3f', '82e46a4d-2989-44a8-b799-e87ea2d0f1cf', '22131ad0-cb62-4609-bec8-7981954475f4'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:15 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8d053f76-a4dd-4096-aed6-dfd8e8741927" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-8d053f76-a4dd-4096-aed6-dfd8e8741927" released by "delete_volume" :: held 1.220s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:15 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:15 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Created reservations ['3321c3b0-e686-48a1-a32a-a65c2ee7bf08', 'c417b7c9-3e58-4636-bc0c-fc10e1452364', 'd59ff1c4-f0f9-4a8a-82d7-189cd2af4d97', '86acfc83-6388-49ec-8004-6505b75f2769'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:15 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:15 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:15 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.516s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Deleted volume successfully. Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-180168fc-8336-4426-8c6c-1cb845c53a15 tempest-VolumesListAdminTestJSON-135517271 None] Lock "cinder-18e23f4f-68a9-44f0-a04e-3729b6cefcb8-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Acquiring lock "cinder-a2f4bb57-6d89-45dc-ad83-5189b64005a4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "cinder-a2f4bb57-6d89-45dc-ad83-5189b64005a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Acquiring lock "cinder-quobyte-a2f4bb57-6d89-45dc-ad83-5189b64005a4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:15 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.486s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Deleted volume successfully. Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "cinder-quobyte-a2f4bb57-6d89-45dc-ad83-5189b64005a4" acquired by "delete_volume" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91be3f78-7bc9-4e7d-acd1-c2bd46103598 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-8d053f76-a4dd-4096-aed6-dfd8e8741927-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[36249f55-adf3-4a4d-920f-ec553f04452d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-f1b7e2ef-91c1-499a-a606-71b8998f0b77-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:16 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 Sep 28 16:18:16 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-f1b7e2ef-91c1-499a-a606-71b8998f0b77-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-quobyte-f1b7e2ef-91c1-499a-a606-71b8998f0b77" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-f1b7e2ef-91c1-499a-a606-71b8998f0b77" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[894cfc6b-0340-4978-b038-7329917b7cb2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:16 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 Sep 28 16:18:16 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:16 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4" returned: 0 in 0.851s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4 Sep 28 16:18:17 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77" returned: 0 in 0.872s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a2f4bb57-6d89-45dc-ad83-5189b64005a4" returned: 0 in 0.451s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:17 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77 Sep 28 16:18:17 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "cinder-quobyte-a2f4bb57-6d89-45dc-ad83-5189b64005a4" released by "delete_volume" :: held 1.401s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:17 devstack cinder-volume[87150]: WARNING cinder.quota [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:18:17 devstack cinder-volume[87150]: WARNING cinder.quota [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Created reservations ['685a4d66-8639-4452-bffd-8fec4e7c0bf3', '32e88e03-c478-4454-b6f8-cd3ad692b0f3', 'b15a1d05-56e9-45c9-85f7-99a01bfce41f', 'e4556c33-6a93-4ad8-99a3-afa205994030'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:17 devstack sudo[99900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:17 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:17 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f1b7e2ef-91c1-499a-a606-71b8998f0b77" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-f1b7e2ef-91c1-499a-a606-71b8998f0b77" released by "delete_volume" :: held 1.400s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Created reservations ['df5af8e4-5bba-4c60-b7d0-00d78f7b554c', 'ab72bc86-bdce-4185-9f9a-9c9a6de8ad6d', '53b1a3e8-7553-4892-8c6c-8f5e8e758f3f', 'ef1bcbeb-0412-48a3-b994-6dc7481405f0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:18 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:18 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:18 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Deleted volume successfully. Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5dcc603c-4ec6-4192-8277-34ddc4180774 tempest-VolumeAndVolumeTypeFromImageTest-2047232380 None] Lock "cinder-a2f4bb57-6d89-45dc-ad83-5189b64005a4-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:18 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Deleted volume successfully. Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61763b72-b648-4946-9afd-f7b246c6f174 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-f1b7e2ef-91c1-499a-a606-71b8998f0b77-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-b7431c7b-a5ff-4bd1-a8ca-e51533b25728-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-b7431c7b-a5ff-4bd1-a8ca-e51533b25728-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "cinder-quobyte-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[122c9a53-00aa-4334-8cdf-aadc50f9bc13]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:19 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 Sep 28 16:18:19 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:19 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" returned: 0 in 0.523s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:19 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728 Sep 28 16:18:19 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:20 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-quobyte-b7431c7b-a5ff-4bd1-a8ca-e51533b25728" released by "delete_volume" :: held 1.108s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Created reservations ['453cd594-40ec-4a57-89aa-ffe155761936', '0aff928e-df12-44a6-a8c1-50ceaf5a7d88', '8719e933-c549-4bc6-a336-e32842d43a5b', 'a1418885-8d9e-4f94-9885-bb3a4a85f416'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:20 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:20 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:20 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Deleted volume successfully. Sep 28 16:18:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-af40f37a-141b-4f7c-9dcd-7d8e4fe25ea6 tempest-VolumesListAdminTestJSON-1884688211 None] Lock "cinder-b7431c7b-a5ff-4bd1-a8ca-e51533b25728-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (6d23db70-7b17-451f-a8eb-3d0c9847505f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1543804-7b3d-40ae-9a20-93483be27dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1543804-7b3d-40ae-9a20-93483be27dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-773305793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86f23f6-2631-40cd-a4ce-0022dac83bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:28Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04e29ccc-9f75-47af-89b5-fd57a952c495),volume_type_id=04e29ccc-9f75-47af-89b5-fd57a952c495)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d6b339-bb21-485c-9c8b-535ec0ac3731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d6b339-bb21-485c-9c8b-535ec0ac3731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0724239-9920-4133-b1f9-29f3b070d4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0724239-9920-4133-b1f9-29f3b070d4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f86f23f6-2631-40cd-a4ce-0022dac83bc1', 'volume_name': 'volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df38123e-e33d-4abc-af9c-d2b1fbf4754c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df38123e-e33d-4abc-af9c-d2b1fbf4754c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885199aa-d008-480e-a68f-24e0b83f996c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume f86f23f6-2631-40cd-a4ce-0022dac83bc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1', 'volume_size': 1} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-773305793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f86f23f6-2631-40cd-a4ce-0022dac83bc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:28Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04e29ccc-9f75-47af-89b5-fd57a952c495),volume_type_id=04e29ccc-9f75-47af-89b5-fd57a952c495)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Creating volume f86f23f6-2631-40cd-a4ce-0022dac83bc1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:28 devstack sudo[99921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 1073741824 Sep 28 16:18:28 devstack sudo[99921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (c9a11c21-fdda-40e2-a309-3eef21aaa088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0374ec0-05d0-4cc5-b9fd-8e08b701813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0374ec0-05d0-4cc5-b9fd-8e08b701813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-638551377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2461c835-033b-41e9-aa35-e3e8cd19a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:29Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3613f25-d830-4a1c-85dd-53a536e60d56),volume_type_id=a3613f25-d830-4a1c-85dd-53a536e60d56)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a81b60f-9d1a-4f1c-b9fb-857c109c720b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a81b60f-9d1a-4f1c-b9fb-857c109c720b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2187abcb-9218-44fc-93d5-cee9778d576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2187abcb-9218-44fc-93d5-cee9778d576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2461c835-033b-41e9-aa35-e3e8cd19a5a6', 'volume_name': 'volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d93889-6c14-4778-befe-ab3176351347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17d93889-6c14-4778-befe-ab3176351347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4383a10-9d66-4846-bfbc-dacc02d7a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume 2461c835-033b-41e9-aa35-e3e8cd19a5a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6', 'volume_size': 1} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:29 devstack sudo[99921]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 1073741824" returned: 0 in 1.123s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:29 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 Sep 28 16:18:29 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:30 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1" returned: 0 in 0.548s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.863s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-638551377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2461c835-033b-41e9-aa35-e3e8cd19a5a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:29Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a3613f25-d830-4a1c-85dd-53a536e60d56),volume_type_id=a3613f25-d830-4a1c-85dd-53a536e60d56)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Creating volume 2461c835-033b-41e9-aa35-e3e8cd19a5a6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:30 devstack sudo[99930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 1073741824 Sep 28 16:18:30 devstack sudo[99930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (885199aa-d008-480e-a68f-24e0b83f996c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c4b642-35e4-48dc-ac1d-34af7993561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 (f86f23f6-2631-40cd-a4ce-0022dac83bc1): created successfully Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c4b642-35e4-48dc-ac1d-34af7993561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (6d23db70-7b17-451f-a8eb-3d0c9847505f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (bcb16e19-db65-4717-82bf-f05d1248e9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f046b1-0868-4bb3-b923-ce73707ffcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f046b1-0868-4bb3-b923-ce73707ffcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274598979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfb9ba-61a2-423d-93f6-94fe7f3cd97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:30Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b7173b4-c5b4-4003-8528-b7daeb168814),volume_type_id=3b7173b4-c5b4-4003-8528-b7daeb168814)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6a5f02-78e4-44fd-9160-a4153ab50cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d6a5f02-78e4-44fd-9160-a4153ab50cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf416bd0-f436-4d46-84fe-3c829b4376bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:30 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:18:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7e6e039d-eb1a-47b8-81e0-447349fcab9e tempest-TestInstancesWithCinderVolumes-2085933186 None] Created volume successfully. Sep 28 16:18:31 devstack sudo[99930]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 1073741824" returned: 0 in 0.854s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:31 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 Sep 28 16:18:31 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6" returned: 0 in 0.503s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:31 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf416bd0-f436-4d46-84fe-3c829b4376bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cedfb9ba-61a2-423d-93f6-94fe7f3cd97b', 'volume_name': 'volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b', 'volume_size': 1, 'image_id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2137479226', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b0957f3522a41d999d6d4d0b6d190b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bfa6d2-946b-41a8-98e2-64347dc49637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45bfa6d2-946b-41a8-98e2-64347dc49637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce0e3d3-821a-46f2-9c6d-948fc15fd192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b', 'volume_size': 1, 'image_id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2137479226', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b0957f3522a41d999d6d4d0b6d190b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7/file', 'properties': {}}, 'image_service': } Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Trying to clone cedfb9ba-61a2-423d-93f6-94fe7f3cd97b from image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4383a10-9d66-4846-bfbc-dacc02d7a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90aeb3e2-e595-4ba9-8799-e6675da77ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 (2461c835-033b-41e9-aa35-e3e8cd19a5a6): created successfully Sep 28 16:18:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90aeb3e2-e595-4ba9-8799-e6675da77ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (c9a11c21-fdda-40e2-a309-3eef21aaa088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1238081b-14d4-4abf-92de-fae9878b2f93 tempest-TestInstancesWithCinderVolumes-2085933186 None] Created volume successfully. Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Flow 'volume_create_manager' (da643ae0-f487-4db5-ab39-8944c4f4c7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd44ba-c012-4309-95e5-165af90b872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfdd44ba-c012-4309-95e5-165af90b872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2043706717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f416e0e4-208f-45af-9f41-cd480a8c13df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b1f661e08d412b89c84f213fbc320b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:35Z,use_quota=True,user_id='7c4778f7bb514acc8205302e5bcdf5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef13c7e1-6b5e-4185-a516-dc695a3c0f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef13c7e1-6b5e-4185-a516-dc695a3c0f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56713e05-724d-499f-8ee7-688849b689da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56713e05-724d-499f-8ee7-688849b689da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f416e0e4-208f-45af-9f41-cd480a8c13df', 'volume_name': 'volume-f416e0e4-208f-45af-9f41-cd480a8c13df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb35b6d4-dbd0-4857-baa3-0d65e106643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb35b6d4-dbd0-4857-baa3-0d65e106643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd2e94-7942-4015-81cb-e628d5bf692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Volume f416e0e4-208f-45af-9f41-cd480a8c13df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f416e0e4-208f-45af-9f41-cd480a8c13df', 'volume_size': 1} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2043706717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f416e0e4-208f-45af-9f41-cd480a8c13df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b1f661e08d412b89c84f213fbc320b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:35Z,use_quota=True,user_id='7c4778f7bb514acc8205302e5bcdf5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Creating volume f416e0e4-208f-45af-9f41-cd480a8c13df {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:35 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df 1073741824 Sep 28 16:18:35 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Flow 'volume_create_manager' (6c4ca129-7202-4df3-94e2-2b58b76a1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515398d5-a3c6-4843-b3bd-76c98dccd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515398d5-a3c6-4843-b3bd-76c98dccd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51842-bb05-4d5c-ab7a-76a87cd57bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7007a26ccc424dbcb38441ed006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:36Z,use_quota=True,user_id='2b12800a9dcb404890c6896efbc3f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f0421-f413-4412-b843-b9374251a801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c23f0421-f413-4412-b843-b9374251a801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e28990-6123-42ab-b94d-cd0834c3d23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:18:35 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df 1073741824" returned: 0 in 0.916s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:36 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df Sep 28 16:18:36 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e28990-6123-42ab-b94d-cd0834c3d23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8ec51842-bb05-4d5c-ab7a-76a87cd57bcc', 'volume_name': 'volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc', 'volume_size': 1, 'image_id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a9753a5b18667e6995d7de769deb9be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c7007a26ccc424dbcb38441ed006912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c8cae65805af3e2dd2c26c2d0bce105247d788799bf4716cf8d8e27c6dd229772ae31f4e7e8b4a6009678bdffebf157e350456699bb7017df96f0ba9b4d5cc', 'id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45738586-6efc-47f4-9e69-cf37fdc95b76/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff80a6-da32-4325-964e-2d96cf5b5e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cff80a6-da32-4325-964e-2d96cf5b5e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e667e2-ade4-46e5-bfc0-a43b063e745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc', 'volume_size': 1, 'image_id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a9753a5b18667e6995d7de769deb9be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c7007a26ccc424dbcb38441ed006912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c8cae65805af3e2dd2c26c2d0bce105247d788799bf4716cf8d8e27c6dd229772ae31f4e7e8b4a6009678bdffebf157e350456699bb7017df96f0ba9b4d5cc', 'id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45738586-6efc-47f4-9e69-cf37fdc95b76/file', 'properties': {}}, 'image_service': } Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Trying to clone 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc from image 45738586-6efc-47f4-9e69-cf37fdc95b76 at location (None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:18:36 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] <== create_volume: return (1373ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbd2e94-7942-4015-81cb-e628d5bf692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f416e0e4-208f-45af-9f41-cd480a8c13df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57e371-5f8e-43c4-b79d-be0ddc8ddcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Volume volume-f416e0e4-208f-45af-9f41-cd480a8c13df (f416e0e4-208f-45af-9f41-cd480a8c13df): created successfully Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e57e371-5f8e-43c4-b79d-be0ddc8ddcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Flow 'volume_create_manager' (da643ae0-f487-4db5-ab39-8944c4f4c7b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42038b43-cb79-43f7-8121-625016356507 tempest-VolumesTransfersTest-631395925 None] Created volume successfully. Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:18:36 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[af06a3d9-c28d-4e16-ac92-086184ecc1e3]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:36 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:36 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:36 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:36 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:36 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.311s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:18:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:18:37 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 0 in 0.560s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:37 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:37 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:37 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 1 in 0.564s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Temporary image 45738586-6efc-47f4-9e69-cf37fdc95b76 is fetched for user 2b12800a9dcb404890c6896efbc3f122. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ee90d-738e-4900-92b9-b51e11d5314e]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:37 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD, size 20.69 MB, duration 6.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:18:37 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Image download 20.69 MB at 3.45 MB/s Sep 28 16:18:37 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:37 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae51dbde-b684-4efe-9d9c-67f6dbb29169]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:38 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD Sep 28 16:18:38 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:38 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 0 in 0.595s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4bedb876-1853-4e31-9fcd-c234fe79d0b8 tempest-VolumesTransfersTest-929964797 None] Transfer volume completed successfully. Sep 28 16:18:38 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:38 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:38 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD" returned: 0 in 0.658s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Temporary image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 is fetched for user 2fd1bfdbc9d040e8a198104edd5a0084. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b77e02a-e194-44a8-8c93-b799c664b5f2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:38 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 1 in 0.574s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ec51842-bb05-4d5c-ab7a-76a87cd57bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7007a26ccc424dbcb38441ed006912',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:36Z,use_quota=True,user_id='2b12800a9dcb404890c6896efbc3f122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Creating volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:38 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:39 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD Sep 28 16:18:39 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:39 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1073741824 Sep 28 16:18:39 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:39 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "cinder-f416e0e4-208f-45af-9f41-cd480a8c13df-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-f416e0e4-208f-45af-9f41-cd480a8c13df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "cinder-quobyte-f416e0e4-208f-45af-9f41-cd480a8c13df" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-quobyte-f416e0e4-208f-45af-9f41-cd480a8c13df" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:39 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1073741824" returned: 0 in 0.775s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd179b2-7adb-4345-ace9-294755b16117]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:39 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc Sep 28 16:18:39 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:39 devstack sudo[99987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df Sep 28 16:18:39 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:40 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-274598979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfb9ba-61a2-423d-93f6-94fe7f3cd97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b0957f3522a41d999d6d4d0b6d190b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:30Z,use_quota=True,user_id='2fd1bfdbc9d040e8a198104edd5a0084',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3b7173b4-c5b4-4003-8528-b7daeb168814),volume_type_id=3b7173b4-c5b4-4003-8528-b7daeb168814)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Creating volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:40 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Attempting download of 45738586-6efc-47f4-9e69-cf37fdc95b76 ((None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}])) to volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:18:40 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1073741824 Sep 28 16:18:40 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:40 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df" returned: 0 in 0.574s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34237ae-954e-4898-aa2c-355811068ab2]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:40 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df Sep 28 16:18:40 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:40 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm Sep 28 16:18:40 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:40 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f416e0e4-208f-45af-9f41-cd480a8c13df" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:40 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm" returned: 0 in 0.466s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-quobyte-f416e0e4-208f-45af-9f41-cd480a8c13df" released by "delete_volume" :: held 1.130s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Created reservations ['6e36a9d7-3794-4d70-a83a-ada547be4204', 'cdef36c2-58b1-4a68-9234-fde85dabc94c', '19070ebc-ab33-4559-aba3-5e1a02e8d3db', '5012d644-dc8f-4375-be1d-87fcb9e5058a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:40 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1073741824" returned: 0 in 0.799s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:41 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm Sep 28 16:18:41 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:41 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b Sep 28 16:18:41 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:41 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:41 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:41 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm" returned: 1 in 0.605s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_45738586-6efc-47f4-9e69-cf37fdc95b76_jg128rzm' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a7f26e-b87e-40ab-bf90-eb2bc37d8ff4]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:41 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Attempting download of bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}])) to volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:18:41 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:41 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4a1dfb-4fa8-4bd8-8b43-eda7d824f784]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:41 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Deleted volume successfully. Sep 28 16:18:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b310743e-900d-4012-a192-4b4bf0fdfa1e tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-f416e0e4-208f-45af-9f41-cd480a8c13df-delete_volume" released by "delete_volume" :: held 2.096s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:41 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18 Sep 28 16:18:41 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:42 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 0 in 0.655s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:42 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:42 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18 Sep 28 16:18:42 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:42 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD Sep 28 16:18:42 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:42 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18" returned: 1 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_h5jawr18' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f6118e-e649-4c22-ad08-6b722f382a7a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:42 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD" returned: 1 in 0.665s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] 45738586-6efc-47f4-9e69-cf37fdc95b76 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:18:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:42 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc Sep 28 16:18:42 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:42 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD Sep 28 16:18:42 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Flow 'volume_create_manager' (c985b156-54e7-4cce-b820-4cee1f8120a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40359ab7-3391-41fc-b33a-5b147bd30b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40359ab7-3391-41fc-b33a-5b147bd30b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1266896311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b108be-4ba0-44e6-aa53-3a0df9e6d4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b1f661e08d412b89c84f213fbc320b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:43Z,use_quota=True,user_id='7c4778f7bb514acc8205302e5bcdf5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592c7ca9-316f-48db-9e52-f4389b125e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592c7ca9-316f-48db-9e52-f4389b125e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e5169c-d19a-4cd2-8d17-c5ee5436d249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75e5169c-d19a-4cd2-8d17-c5ee5436d249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54b108be-4ba0-44e6-aa53-3a0df9e6d4a8', 'volume_name': 'volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfff46d-a4a8-42f4-8e11-6168dfcf7e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbfff46d-a4a8-42f4-8e11-6168dfcf7e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c21b31-365e-4c2b-9c30-8dae3ba9169d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Volume 54b108be-4ba0-44e6-aa53-3a0df9e6d4a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8', 'volume_size': 1} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1266896311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b108be-4ba0-44e6-aa53-3a0df9e6d4a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6b1f661e08d412b89c84f213fbc320b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:43Z,use_quota=True,user_id='7c4778f7bb514acc8205302e5bcdf5ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Creating volume 54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:43 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD" returned: 0 in 0.600s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:43 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 1073741824 Sep 28 16:18:43 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:43 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b Sep 28 16:18:43 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:43 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" returned: 0 in 0.797s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_45738586-6efc-47f4-9e69-cf37fdc95b76_m_96q57vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:18:43 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:43 devstack sudo[100058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1G Sep 28 16:18:43 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:43 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 1073741824" returned: 0 in 0.691s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:44 devstack sudo[100064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 Sep 28 16:18:44 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:44 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc 1G" returned: 0 in 0.691s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Downloaded image 45738586-6efc-47f4-9e69-cf37fdc95b76 ((None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}])) to volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Temporary image 45738586-6efc-47f4-9e69-cf37fdc95b76 for user 2b12800a9dcb404890c6896efbc3f122 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Marking volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Copying metadata from image 45738586-6efc-47f4-9e69-cf37fdc95b76 to 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Creating volume glance metadata for volume 8ec51842-bb05-4d5c-ab7a-76a87cd57bcc backed by image 45738586-6efc-47f4-9e69-cf37fdc95b76 with: {'image_id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9a9753a5b18667e6995d7de769deb9be', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26e667e2-ade4-46e5-bfc0-a43b063e745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc', 'volume_size': 1, 'image_id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/45738586-6efc-47f4-9e69-cf37fdc95b76', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9a9753a5b18667e6995d7de769deb9be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c7007a26ccc424dbcb38441ed006912', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77c8cae65805af3e2dd2c26c2d0bce105247d788799bf4716cf8d8e27c6dd229772ae31f4e7e8b4a6009678bdffebf157e350456699bb7017df96f0ba9b4d5cc', 'id': '45738586-6efc-47f4-9e69-cf37fdc95b76', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/45738586-6efc-47f4-9e69-cf37fdc95b76/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41acf4f-4d61-4436-a115-5dc92173d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:44 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Volume volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc (8ec51842-bb05-4d5c-ab7a-76a87cd57bcc): created successfully Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41acf4f-4d61-4436-a115-5dc92173d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Flow 'volume_create_manager' (6c4ca129-7202-4df3-94e2-2b58b76a1efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" returned: 0 in 0.451s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c21b31-365e-4c2b-9c30-8dae3ba9169d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc68faf1-1cef-4e56-8ebc-fae000097200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-29eb55e8-2104-499e-98c8-981bb3eb19bc tempest-VolumeImageDependencyTests-1961659531 None] Created volume successfully. Sep 28 16:18:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Volume volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 (54b108be-4ba0-44e6-aa53-3a0df9e6d4a8): created successfully Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc68faf1-1cef-4e56-8ebc-fae000097200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Flow 'volume_create_manager' (c985b156-54e7-4cce-b820-4cee1f8120a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d247b332-fe29-4f57-95f3-7b03e14da205 tempest-VolumesTransfersTest-631395925 None] Created volume successfully. Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Acquiring lock "cinder-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "cinder-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Acquiring lock "cinder-quobyte-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "cinder-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "cinder-quobyte-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eea24af-c7ab-4ec6-a57d-9e81fbc104b5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "cinder-quobyte-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-quobyte-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3dfcb-74b7-48cb-b626-b052c6ee0881]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:18:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:46 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc Sep 28 16:18:46 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:46 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 Sep 28 16:18:46 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:46 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" returned: 0 in 3.107s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7_54pwv6_ldevstack@QuobyteHD, size 112.00 MB, duration 3.11 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:18:46 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Converted 112.00 MB image at 36.03 MB/s Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:46 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1G Sep 28 16:18:46 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:46 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" returned: 0 in 0.720s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:46 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc Sep 28 16:18:46 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:46 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" returned: 0 in 0.674s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:46 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8 Sep 28 16:18:46 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:46 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:46 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b 1G" returned: 0 in 0.566s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Downloaded image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}])) to volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Temporary image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 for user 2fd1bfdbc9d040e8a198104edd5a0084 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Marking volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:18:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "cinder-quobyte-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc" released by "delete_volume" :: held 1.228s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Copying metadata from image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 to cedfb9ba-61a2-423d-93f6-94fe7f3cd97b. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Creating volume glance metadata for volume cedfb9ba-61a2-423d-93f6-94fe7f3cd97b backed by image bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7 with: {'image_id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'image_name': 'tempest-scenario-img--2137479226', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:18:47 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-quobyte-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8" released by "delete_volume" :: held 1.212s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Created reservations ['de63dd7b-a0c6-4552-8b9d-01bf805d2ea7', 'fc5a172d-aca0-496e-99b1-27ef9acc2ecc', '156d97d7-f01f-4551-bef5-dde46cb13d34', 'a9dbcebb-68bd-4bb0-b72d-0368324b3d40'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce0e3d3-821a-46f2-9c6d-948fc15fd192) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b', 'volume_size': 1, 'image_id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2137479226', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '2b0957f3522a41d999d6d4d0b6d190b0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7', 'created_at': datetime.datetime(2026, 9, 28, 14, 18, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 18, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bfa8c1bc-8ca0-428e-b469-0f4a5d0df4b7/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d03c3b-1aab-41c9-8e81-7e28b4c790d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Volume volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b (cedfb9ba-61a2-423d-93f6-94fe7f3cd97b): created successfully Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d03c3b-1aab-41c9-8e81-7e28b4c790d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Flow 'volume_create_manager' (bcb16e19-db65-4717-82bf-f05d1248e9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-14e3b1ba-44c9-4866-86a5-1f79a8daa5eb tempest-TestInstancesWithCinderVolumes-2085933186 None] Created volume successfully. Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Created reservations ['fbdeaccf-fc1f-40d9-b384-1b0c57f54837', '94f4df22-0391-4c76-a808-73a16b2bb7db', 'b86c970e-dc9c-4950-bde0-ac4a2fa3b4e4', 'd5a3f2f7-856c-4751-9d53-acbd0a326571'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:18:47 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:47 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:47 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:18:47 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:47 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Deleted volume successfully. Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c06aad44-2770-4e06-b1ef-ba6c7179f2c5 tempest-VolumeImageDependencyTests-1961659531 None] Lock "cinder-8ec51842-bb05-4d5c-ab7a-76a87cd57bcc-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:47 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:18:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Deleted volume successfully. Sep 28 16:18:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-15e7d446-7925-4858-b043-f1af488a18c2 tempest-VolumesTransfersTest-1651872254 None] Lock "cinder-54b108be-4ba0-44e6-aa53-3a0df9e6d4a8-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:18:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f0aa4dd4-da27-47ea-ac7d-43f4857bc0be req-eb563ace-cbe9-4481-830c-e0eca5b1b68a tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f0aa4dd4-da27-47ea-ac7d-43f4857bc0be req-eb563ace-cbe9-4481-830c-e0eca5b1b68a tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f0aa4dd4-da27-47ea-ac7d-43f4857bc0be req-eb563ace-cbe9-4481-830c-e0eca5b1b68a tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-f0aa4dd4-da27-47ea-ac7d-43f4857bc0be req-eb563ace-cbe9-4481-830c-e0eca5b1b68a tempest-TestInstancesWithCinderVolumes-2085933186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bea214e-788d-485f-a7e7-8ee395eb8517', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:18:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-f0aa4dd4-da27-47ea-ac7d-43f4857bc0be req-eb563ace-cbe9-4481-830c-e0eca5b1b68a tempest-TestInstancesWithCinderVolumes-2085933186 None] attachment_update completed successfully. Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Flow 'volume_create_manager' (4d77bee6-0d14-4e0d-913c-c5e7df02f89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1477b-a7f8-458a-9c40-9c775fece06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1477b-a7f8-458a-9c40-9c775fece06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31711d46-d9a4-4fcb-bba1-4c5edf77fcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e3d1689ff447da979c5061e08f67ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:55Z,use_quota=True,user_id='3a8a4d257c884277b3718d993eff4545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03a29a-9f70-4157-8496-e6d9278209b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e03a29a-9f70-4157-8496-e6d9278209b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a59aec5-5c3f-42c6-a322-ee702bcda530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a59aec5-5c3f-42c6-a322-ee702bcda530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31711d46-d9a4-4fcb-bba1-4c5edf77fcb6', 'volume_name': 'volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0644ac7a-ad8f-478a-a6db-725ab78ce11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0644ac7a-ad8f-478a-a6db-725ab78ce11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080bc026-ad7f-4cb2-b2a1-f82771ffc579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Volume 31711d46-d9a4-4fcb-bba1-4c5edf77fcb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6', 'volume_size': 1} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31711d46-d9a4-4fcb-bba1-4c5edf77fcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e3d1689ff447da979c5061e08f67ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:55Z,use_quota=True,user_id='3a8a4d257c884277b3718d993eff4545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Creating volume 31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:55 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 1073741824 Sep 28 16:18:55 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 1073741824" returned: 0 in 0.726s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:56 devstack sudo[100120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 Sep 28 16:18:56 devstack sudo[100120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:18:56 devstack sudo[100120]: pam_unix(sudo:session): session closed for user root Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" returned: 0 in 0.372s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (080bc026-ad7f-4cb2-b2a1-f82771ffc579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9471f2-b807-4ce6-8025-c776458e7d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Volume volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 (31711d46-d9a4-4fcb-bba1-4c5edf77fcb6): created successfully Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9471f2-b807-4ce6-8025-c776458e7d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Flow 'volume_create_manager' (4d77bee6-0d14-4e0d-913c-c5e7df02f89b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3f1fe617-d320-40fd-adc9-6e343182e06a tempest-CinderUnicodeTest-1588975912 None] Created volume successfully. Sep 28 16:18:58 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=107,cinder:SELECT=89,cinder:INSERT=44,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:58 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=88,cinder:UPDATE=106,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:18:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:18:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Flow 'volume_create_manager' (8e041618-262e-44ec-9108-bac258c20726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:18:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b7d73-6b0f-48d4-b563-9b932f1e0e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa8b7d73-6b0f-48d4-b563-9b932f1e0e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777209634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ed6691-cefd-4bbd-8c72-e3feaf5c9400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e3d1689ff447da979c5061e08f67ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:59Z,use_quota=True,user_id='3a8a4d257c884277b3718d993eff4545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010595e7-93c3-45ec-b3b7-7d50d0f61508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (010595e7-93c3-45ec-b3b7-7d50d0f61508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd39daf2-08be-433f-be83-ded7728a0c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd39daf2-08be-433f-be83-ded7728a0c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ed6691-cefd-4bbd-8c72-e3feaf5c9400', 'volume_name': 'volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f15e7bb-f383-4cce-97c3-47dd0dadd744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f15e7bb-f383-4cce-97c3-47dd0dadd744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ce2f38-cde3-4f27-a9e6-c3d8dc637774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:18:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Volume 75ed6691-cefd-4bbd-8c72-e3feaf5c9400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400', 'volume_size': 1} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:18:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777209634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ed6691-cefd-4bbd-8c72-e3feaf5c9400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98e3d1689ff447da979c5061e08f67ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:18:59Z,use_quota=True,user_id='3a8a4d257c884277b3718d993eff4545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Creating volume 75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:18:59 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:18:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:18:59 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 1073741824 Sep 28 16:18:59 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:00 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 1073741824" returned: 0 in 1.096s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:00 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 Sep 28 16:19:00 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:01 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" returned: 0 in 0.785s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] <== create_volume: return (2043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ce2f38-cde3-4f27-a9e6-c3d8dc637774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af3424-2865-4d8e-bc68-77676edfbc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Volume volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 (75ed6691-cefd-4bbd-8c72-e3feaf5c9400): created successfully Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92af3424-2865-4d8e-bc68-77676edfbc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Flow 'volume_create_manager' (8e041618-262e-44ec-9108-bac258c20726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9bbb9878-9dc6-4952-a747-b8754e5ccd9d tempest-CinderUnicodeTest-1588975912 None] Created volume successfully. Sep 28 16:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Creating offline snapshot b7f0740b-d4c8-4b60-91c0-fb99d4f7064b of volume 75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e307d346-5a96-415f-b498-8088fc3e6c04]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:03 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 Sep 28 16:19:03 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:04 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" returned: 0 in 1.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:04 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b 1G Sep 28 16:19:04 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:05 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b 1G" returned: 0 in 1.016s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:05 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b Sep 28 16:19:05 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" returned: 0 in 0.559s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b is being set with open permissions: ugo+rw Sep 28 16:19:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b Sep 28 16:19:06 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:06 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" returned: 0 in 0.634s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:06 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info Sep 28 16:19:06 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:07 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info" returned: 0 in 0.636s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:07 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info is being set with open permissions: ugo+rw Sep 28 16:19:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:07 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info Sep 28 16:19:07 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:08 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.info" returned: 0 in 0.816s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.182s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9f45d758-c256-4894-ad36-fc00d060305a tempest-CinderUnicodeTest-1588975912 None] Create snapshot completed successfully Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-quobyte-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Deleting offline snapshot b7f0740b-d4c8-4b60-91c0-fb99d4f7064b of volume 75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] snapshot_file for this snap is: volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185935b-5c33-4ebe-b656-ddb9922bf0cb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:09 devstack sudo[100701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b Sep 28 16:19:09 devstack sudo[100701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:09 devstack sudo[100701]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" returned: 0 in 0.866s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42a1f7-c26f-4a83-8a07-a93c5d3c1498]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:10 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 Sep 28 16:19:10 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:10 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Flow 'volume_create_manager' (a55db640-8db9-461e-b447-6c4e80c820c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5951a6-42ad-42ae-8465-be4550a9eb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5951a6-42ad-42ae-8465-be4550a9eb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1890880459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2eac24d-4b7c-4750-8790-f7ead589eb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc23ce9e32d4d00b334868e6a29cfc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:11Z,use_quota=True,user_id='2908aa72505a46738963947263a9b3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f777d914-c92f-46bb-bfe5-2bb96526a7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f777d914-c92f-46bb-bfe5-2bb96526a7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbd9169-2cd8-44dc-9020-387dd839980d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:19:11 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" returned: 0 in 1.170s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:11 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b Sep 28 16:19:11 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" returned: 0 in 0.943s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:12 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b Sep 28 16:19:12 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efbd9169-2cd8-44dc-9020-387dd839980d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2eac24d-4b7c-4750-8790-f7ead589eb78', 'volume_name': 'volume-f2eac24d-4b7c-4750-8790-f7ead589eb78', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05179b1d-73ec-42d4-9ef7-ea5ab4de546f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05179b1d-73ec-42d4-9ef7-ea5ab4de546f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce828e1-b85a-431d-9853-d8349bed6e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:12 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Volume f2eac24d-4b7c-4750-8790-f7ead589eb78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2eac24d-4b7c-4750-8790-f7ead589eb78', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:19:12 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Trying to clone f2eac24d-4b7c-4750-8790-f7ead589eb78 from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:19:13 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400.b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" returned: 0 in 1.033s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b" released by "_delete_snapshot" :: held 4.440s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Flow 'volume_create_manager' (3d316c95-7f39-4cc4-90a2-ce0afb5ca8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37192362-06e6-4ad8-8a6b-eee8a51108c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" released by "delete_snapshot" :: held 4.545s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37192362-06e6-4ad8-8a6b-eee8a51108c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50652666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decc70fe-6213-4b12-a551-05c124d54409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25494f7e208d425c828a056693f22a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:13Z,use_quota=True,user_id='5663f66ead05442291df31f35d5fe967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6e5759-850c-4522-897f-a8bbcd72169f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d6e5759-850c-4522-897f-a8bbcd72169f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b28c485-3412-420f-bb21-3937d76ae066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b28c485-3412-420f-bb21-3937d76ae066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'decc70fe-6213-4b12-a551-05c124d54409', 'volume_name': 'volume-decc70fe-6213-4b12-a551-05c124d54409', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9775a8-ff29-4be9-bd48-756a172a4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be9775a8-ff29-4be9-bd48-756a172a4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d445e8-9674-4300-9bbd-6066faf7a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Volume decc70fe-6213-4b12-a551-05c124d54409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-decc70fe-6213-4b12-a551-05c124d54409', 'volume_size': 1} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-50652666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=decc70fe-6213-4b12-a551-05c124d54409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25494f7e208d425c828a056693f22a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:13Z,use_quota=True,user_id='5663f66ead05442291df31f35d5fe967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Creating volume decc70fe-6213-4b12-a551-05c124d54409 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:13 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 1073741824 Sep 28 16:19:13 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD, size 20.69 MB, duration 1.18 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:19:13 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Image download 20.69 MB at 17.58 MB/s Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Created reservations ['9ffbf58f-2107-4a99-8ffe-522fff5c3da4', '33330d04-dec3-463e-9f0b-6d4d67c97543', '176d2222-365c-442e-baed-25081a3dfab6', 'e4859776-939e-4c1d-9465-168916665518'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a06b08-2c1a-45d6-abf4-2ff55fb90fb6]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:14 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD Sep 28 16:19:14 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Delete snapshot completed successfully. Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32f73628-8178-4338-92db-2ae7329bc96f tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-b7f0740b-d4c8-4b60-91c0-fb99d4f7064b-delete_snapshot" released by "delete_snapshot" :: held 5.312s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-75ed6691-cefd-4bbd-8c72-e3feaf5c9400-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-75ed6691-cefd-4bbd-8c72-e3feaf5c9400-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:14 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:14 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 1073741824" returned: 0 in 1.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD" returned: 0 in 0.990s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b is fetched for user 2908aa72505a46738963947263a9b3ce. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f3646c-37db-4c68-ac4a-74aae83804c9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 Sep 28 16:19:15 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc49077-a41c-484f-9d59-d488ec528d02]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack sudo[100734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 Sep 28 16:19:15 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD Sep 28 16:19:15 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409" returned: 0 in 0.719s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.170s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67d445e8-9674-4300-9bbd-6066faf7a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-decc70fe-6213-4b12-a551-05c124d54409', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21e548-2acd-411c-b1c9-13e854c8ce59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:15 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Volume volume-decc70fe-6213-4b12-a551-05c124d54409 (decc70fe-6213-4b12-a551-05c124d54409): created successfully Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf21e548-2acd-411c-b1c9-13e854c8ce59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Flow 'volume_create_manager' (3d316c95-7f39-4cc4-90a2-ce0afb5ca8e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-114677f6-be40-4e22-948c-033db36a4289 tempest-VolumesTransfersV357Test-897576566 None] Created volume successfully. Sep 28 16:19:15 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" returned: 0 in 1.059s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:15 devstack sudo[100750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400 Sep 28 16:19:15 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:15 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD" returned: 0 in 0.928s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1890880459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2eac24d-4b7c-4750-8790-f7ead589eb78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7dc23ce9e32d4d00b334868e6a29cfc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:11Z,use_quota=True,user_id='2908aa72505a46738963947263a9b3ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Creating volume f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1073741824 Sep 28 16:19:16 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:16 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" returned: 0 in 0.577s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-75ed6691-cefd-4bbd-8c72-e3feaf5c9400" released by "delete_volume" :: held 1.776s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Created reservations ['30409a7d-287f-4b63-8ad9-25d95dd0355f', 'a8bd2fbd-e076-4d4c-89ac-38081161f96c', 'd13b6db7-9cfc-491b-995f-952c36e41b98', '66da03ab-12e8-4974-95f9-d49571aaee99'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:16 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:16 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:17 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1073741824" returned: 0 in 1.020s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 Sep 28 16:19:17 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "cinder-quobyte-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[503e8bca-aeb0-49ca-b06c-bcc9df87f7f2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:17 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78" returned: 0 in 0.645s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:17 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.943s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Deleted volume successfully. Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-11749ba2-7f66-407b-a3c9-f2e91c16a0c9 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-75ed6691-cefd-4bbd-8c72-e3feaf5c9400-delete_volume" released by "delete_volume" :: held 3.261s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:17 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Attempting download of 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume f2eac24d-4b7c-4750-8790-f7ead589eb78. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:19:17 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 Sep 28 16:19:17 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f9339e-09ea-44a4-bde9-b7d14824bad4]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6 Sep 28 16:19:18 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" returned: 0 in 1.052s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1f04399c-ca38-426a-9f95-7d91810f4a47 tempest-VolumesTransfersV357Test-1945881809 None] Transfer volume completed successfully. Sep 28 16:19:18 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6 Sep 28 16:19:18 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:18 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6" returned: 0 in 0.866s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" returned: 0 in 0.497s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-quobyte-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6" released by "delete_volume" :: held 1.684s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:19 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6 Sep 28 16:19:19 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Created reservations ['2d80a048-781d-42b3-b44a-1c09b52b4209', '8c3ece53-15a7-495e-9c15-0340bb26b2ab', 'fb43f072-3285-46ba-9d06-f5586a8c527b', '9de9c974-2e28-4004-a592-523c07f86e00'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:19 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6" returned: 1 in 0.550s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_jpc74ku6' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d05607f-e3ac-4f0a-bead-4d14ae0afc2e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:19 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD Sep 28 16:19:19 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:19 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:19 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "cinder-decc70fe-6213-4b12-a551-05c124d54409-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-decc70fe-6213-4b12-a551-05c124d54409-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:20 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.601s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Deleted volume successfully. Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "cinder-quobyte-decc70fe-6213-4b12-a551-05c124d54409" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a3cec63f-332c-4a2f-b000-f8488f027573 tempest-CinderUnicodeTest-1588975912 None] Lock "cinder-31711d46-d9a4-4fcb-bba1-4c5edf77fcb6-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-quobyte-decc70fe-6213-4b12-a551-05c124d54409" acquired by "delete_volume" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ac5fa-bb23-47da-b927-e25096ae84ae]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] 4199de88-fb3b-44ba-ad33-1430d8c72a6b was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:19:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:20 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 Sep 28 16:19:20 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:20 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 Sep 28 16:19:20 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409" returned: 0 in 0.777s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:21 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409 Sep 28 16:19:21 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:21 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-decc70fe-6213-4b12-a551-05c124d54409" returned: 0 in 0.549s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-quobyte-decc70fe-6213-4b12-a551-05c124d54409" released by "delete_volume" :: held 1.459s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Created reservations ['323c64cf-dfcb-4af3-8383-c299732b4f25', 'fcd4d09c-ce3a-46ef-bb60-af26514fba23', 'ad0c1dd6-364f-4e5d-899e-8fa33ed49ff0', '8f61d774-3bc1-4b47-b1ab-49f651fac3bf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:22 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:22 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:22 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.613s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Deleted volume successfully. Sep 28 16:19:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-352c955f-4506-4a3c-a2ff-d70d9949b8bc tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-decc70fe-6213-4b12-a551-05c124d54409-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:24 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78" returned: 0 in 4.031s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_bfxdzrrrdevstack@QuobyteHD, size 112.00 MB, duration 4.04 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:19:24 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Converted 112.00 MB image at 27.75 MB/s Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:24 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1G Sep 28 16:19:24 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Flow 'volume_create_manager' (632b116b-d40a-43c3-9afd-2607e2021149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b79d8f-bedf-4423-922c-2462c1b024d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59b79d8f-bedf-4423-922c-2462c1b024d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1402198616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53232f78-d6e5-4793-875c-5f1d9d8da69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25494f7e208d425c828a056693f22a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:24Z,use_quota=True,user_id='5663f66ead05442291df31f35d5fe967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e111f0e9-834a-4ad4-b41c-4b56782f0b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e111f0e9-834a-4ad4-b41c-4b56782f0b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9790e7c-721f-40ff-b048-2698cb526536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9790e7c-721f-40ff-b048-2698cb526536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53232f78-d6e5-4793-875c-5f1d9d8da69a', 'volume_name': 'volume-53232f78-d6e5-4793-875c-5f1d9d8da69a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8a1d87-4d6a-43fb-a817-a2a4ccdae6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a8a1d87-4d6a-43fb-a817-a2a4ccdae6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53385a60-caa5-4d65-b6f2-df64748f8fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Volume 53232f78-d6e5-4793-875c-5f1d9d8da69a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53232f78-d6e5-4793-875c-5f1d9d8da69a', 'volume_size': 1} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1402198616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53232f78-d6e5-4793-875c-5f1d9d8da69a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25494f7e208d425c828a056693f22a81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:24Z,use_quota=True,user_id='5663f66ead05442291df31f35d5fe967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Creating volume 53232f78-d6e5-4793-875c-5f1d9d8da69a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:19:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:24 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a 1073741824 Sep 28 16:19:24 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 1G" returned: 0 in 0.517s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Downloaded image 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume f2eac24d-4b7c-4750-8790-f7ead589eb78 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b for user 2908aa72505a46738963947263a9b3ce is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Marking volume f2eac24d-4b7c-4750-8790-f7ead589eb78 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Copying metadata from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b to f2eac24d-4b7c-4750-8790-f7ead589eb78. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Creating volume glance metadata for volume f2eac24d-4b7c-4750-8790-f7ead589eb78 backed by image 4199de88-fb3b-44ba-ad33-1430d8c72a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce828e1-b85a-431d-9853-d8349bed6e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2eac24d-4b7c-4750-8790-f7ead589eb78', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fe219f-8de3-42ca-8a76-98e7f5accb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Volume volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 (f2eac24d-4b7c-4750-8790-f7ead589eb78): created successfully Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96fe219f-8de3-42ca-8a76-98e7f5accb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Flow 'volume_create_manager' (a55db640-8db9-461e-b447-6c4e80c820c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d92b117-bc5d-4c8c-a5c3-d85e6ace8627 tempest-TestShelveInstance-614320898 None] Created volume successfully. Sep 28 16:19:25 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a 1073741824" returned: 0 in 0.868s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:25 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a Sep 28 16:19:25 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:25 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53385a60-caa5-4d65-b6f2-df64748f8fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53232f78-d6e5-4793-875c-5f1d9d8da69a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74becbd5-5398-4cf5-b8df-fd466f7688a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Volume volume-53232f78-d6e5-4793-875c-5f1d9d8da69a (53232f78-d6e5-4793-875c-5f1d9d8da69a): created successfully Sep 28 16:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74becbd5-5398-4cf5-b8df-fd466f7688a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Flow 'volume_create_manager' (632b116b-d40a-43c3-9afd-2607e2021149) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9b33b0d3-9c63-4ec1-bf45-6df8aea0e2a9 tempest-VolumesTransfersV357Test-897576566 None] Created volume successfully. Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "cinder-53232f78-d6e5-4793-875c-5f1d9d8da69a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-53232f78-d6e5-4793-875c-5f1d9d8da69a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "cinder-quobyte-53232f78-d6e5-4793-875c-5f1d9d8da69a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-quobyte-53232f78-d6e5-4793-875c-5f1d9d8da69a" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eeb9a1-4c55-478e-bde7-161c154c52a1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:27 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a Sep 28 16:19:27 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:28 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a" returned: 0 in 0.663s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:28 devstack sudo[100881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a Sep 28 16:19:28 devstack sudo[100881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:28 devstack sudo[100881]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-53232f78-d6e5-4793-875c-5f1d9d8da69a" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-quobyte-53232f78-d6e5-4793-875c-5f1d9d8da69a" released by "delete_volume" :: held 1.128s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Created reservations ['c93aa3ba-ab83-4f9a-8138-d03fa020e532', '12ecec87-e92e-40d0-bef7-b75cca56b202', '4ee944ff-9559-4a59-8960-0c84c2512e48', '815f231a-3eb8-44e9-95eb-1da931183bcc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:28 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:28 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:29 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:29 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Deleted volume successfully. Sep 28 16:19:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ed5a99a0-d9c7-464b-906f-49602a0d1d25 tempest-VolumesTransfersV357Test-1219291665 None] Lock "cinder-53232f78-d6e5-4793-875c-5f1d9d8da69a-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-047cf306-152b-4ea9-a2d9-13ce2cf16a03 req-2106edc9-410f-4ef2-8eeb-3c696d51b1ab tempest-TestShelveInstance-614320898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-047cf306-152b-4ea9-a2d9-13ce2cf16a03 req-2106edc9-410f-4ef2-8eeb-3c696d51b1ab tempest-TestShelveInstance-614320898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-047cf306-152b-4ea9-a2d9-13ce2cf16a03 req-2106edc9-410f-4ef2-8eeb-3c696d51b1ab tempest-TestShelveInstance-614320898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-047cf306-152b-4ea9-a2d9-13ce2cf16a03 req-2106edc9-410f-4ef2-8eeb-3c696d51b1ab tempest-TestShelveInstance-614320898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-f2eac24d-4b7c-4750-8790-f7ead589eb78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9280e5ed-3b49-4d19-ae43-0aa023641380', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:19:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-047cf306-152b-4ea9-a2d9-13ce2cf16a03 req-2106edc9-410f-4ef2-8eeb-3c696d51b1ab tempest-TestShelveInstance-614320898 None] attachment_update completed successfully. Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:36 devstack sudo[100943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:36 devstack sudo[100943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:37 devstack sudo[100943]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.614s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:19:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:19:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:19:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=49,cinder:INSERT=23,cinder:UPDATE=59,cinder:DELETE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=53,cinder:UPDATE=48,cinder:DELETE=6,cinder:INSERT=15 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:19:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d2ce8bc7-de6a-49a3-b83b-316a93fd8d67 req-b363501a-25f1-4f58-880c-0b986b6cdecf tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d2ce8bc7-de6a-49a3-b83b-316a93fd8d67 req-b363501a-25f1-4f58-880c-0b986b6cdecf tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d2ce8bc7-de6a-49a3-b83b-316a93fd8d67 req-b363501a-25f1-4f58-880c-0b986b6cdecf tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-d2ce8bc7-de6a-49a3-b83b-316a93fd8d67 req-b363501a-25f1-4f58-880c-0b986b6cdecf tempest-TestInstancesWithCinderVolumes-2085933186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '900cdc5c-191b-4429-8c18-6bf9036b4ef4', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:19:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-d2ce8bc7-de6a-49a3-b83b-316a93fd8d67 req-b363501a-25f1-4f58-880c-0b986b6cdecf tempest-TestInstancesWithCinderVolumes-2085933186 None] attachment_update completed successfully. Sep 28 16:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f9b4ed04-9f15-479d-827a-d40ec6d7355e req-02e57d9e-7649-4a83-b178-c908fc9ec837 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f9b4ed04-9f15-479d-827a-d40ec6d7355e req-02e57d9e-7649-4a83-b178-c908fc9ec837 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f9b4ed04-9f15-479d-827a-d40ec6d7355e req-02e57d9e-7649-4a83-b178-c908fc9ec837 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-f9b4ed04-9f15-479d-827a-d40ec6d7355e req-02e57d9e-7649-4a83-b178-c908fc9ec837 tempest-TestInstancesWithCinderVolumes-2085933186 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e577c94c-053a-43d1-9ea9-d20f47fc5644', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:19:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-f9b4ed04-9f15-479d-827a-d40ec6d7355e req-02e57d9e-7649-4a83-b178-c908fc9ec837 tempest-TestInstancesWithCinderVolumes-2085933186 None] attachment_update completed successfully. Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Flow 'volume_create_manager' (151516e0-e45f-4082-b270-1841a5c65ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057e39ba-cff9-4848-b570-b5d28be418a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (057e39ba-cff9-4848-b570-b5d28be418a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-408370719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2199dde-45f0-4084-9c8f-fa83d74bec9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0085f375f44c89a0a161756b2a756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:46Z,use_quota=True,user_id='c52369eba185412cbb049adca34a2779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b3e71a-0e39-45f7-a3d0-840c47d3a0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01b3e71a-0e39-45f7-a3d0-840c47d3a0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e62a66-2d9a-4316-8204-b3e013f0ecbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e62a66-2d9a-4316-8204-b3e013f0ecbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'volume_name': 'volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082d383-6260-4ab6-b540-5b4368466d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7082d383-6260-4ab6-b540-5b4368466d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6801b0-cd28-4eff-af45-df399e162845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Volume e2199dde-45f0-4084-9c8f-fa83d74bec9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'volume_size': 1} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-408370719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2199dde-45f0-4084-9c8f-fa83d74bec9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0085f375f44c89a0a161756b2a756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:46Z,use_quota=True,user_id='c52369eba185412cbb049adca34a2779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Creating volume e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:19:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:19:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:46 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c 1073741824 Sep 28 16:19:46 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:47 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c 1073741824" returned: 0 in 1.230s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:47 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:19:47 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:48 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.580s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] <== create_volume: return (1968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e6801b0-cd28-4eff-af45-df399e162845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d5b7f2-fd3f-407f-b285-06d4db906a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Volume volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c (e2199dde-45f0-4084-9c8f-fa83d74bec9c): created successfully Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12d5b7f2-fd3f-407f-b285-06d4db906a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Flow 'volume_create_manager' (151516e0-e45f-4082-b270-1841a5c65ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-18130115-611b-4fdb-be48-1acccc93a927 tempest-VolumesCloneTest-1777134440 None] Created volume successfully. Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Flow 'volume_create_manager' (47043584-e4e3-48ef-b9ed-ddad63096d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94063ae3-2ef7-4b8c-bb67-88202974d9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94063ae3-2ef7-4b8c-bb67-88202974d9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1527813380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fbaa95-ae5c-464a-beb6-e765233b7365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca0085f375f44c89a0a161756b2a756',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:19:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e2199dde-45f0-4084-9c8f-fa83d74bec9c,status='creating',terminated_at=None,updated_at=2026-09-28T14:19:50Z,use_quota=True,user_id='c52369eba185412cbb049adca34a2779',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03a469-af21-403f-9d83-b30ebb800d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a03a469-af21-403f-9d83-b30ebb800d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02451356-1ac4-43bf-b532-579802fa9b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02451356-1ac4-43bf-b532-579802fa9b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b5fbaa95-ae5c-464a-beb6-e765233b7365', 'volume_name': 'volume-b5fbaa95-ae5c-464a-beb6-e765233b7365', 'volume_size': 2, 'source_volid': 'e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55591b65-7ce0-465a-912b-88cdb7a51b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55591b65-7ce0-465a-912b-88cdb7a51b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1f7542-5d63-4726-bb84-4cbf7bac91b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:19:50 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Volume b5fbaa95-ae5c-464a-beb6-e765233b7365: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b5fbaa95-ae5c-464a-beb6-e765233b7365', 'volume_size': 2, 'source_volid': 'e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'source_volstatus': 'available'} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:50 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Cloning volume e2199dde-45f0-4084-9c8f-fa83d74bec9c to volume b5fbaa95-ae5c-464a-beb6-e765233b7365 Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Creating offline snapshot 717da5d3-97e5-4769-adc4-9ded1dbf3382 of volume e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e2fd2b-b28d-4d46-98f9-2c11a5fb1332]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:50 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:19:50 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:50 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 1G Sep 28 16:19:51 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:51 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 1G" returned: 0 in 0.665s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:51 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:19:51 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 is being set with open permissions: ugo+rw Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:19:52 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.365s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info Sep 28 16:19:52 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:52 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:52 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info is being set with open permissions: ugo+rw Sep 28 16:19:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:52 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info Sep 28 16:19:52 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:53 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.info" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] snapshot: 717da5d3-97e5-4769-adc4-9ded1dbf3382, volume: b5fbaa95-ae5c-464a-beb6-e765233b7365, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a6828-61c2-4817-8775-f2eeaeda8acc]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:53 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:19:53 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:53 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[997c2e80-8768-471b-9d9d-ed3a143f0d99]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:54 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:19:54 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:54 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:54 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 Sep 28 16:19:54 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-4db0610a-23d3-4dae-8415-37943569cb36 req-084b9cd0-0444-4b4c-81d3-b164797d6a92 tempest-TestInstancesWithCinderVolumes-2085933186 None] Terminate volume connection completed successfully. Sep 28 16:19:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-4db0610a-23d3-4dae-8415-37943569cb36 req-084b9cd0-0444-4b4c-81d3-b164797d6a92 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleting attachment 900cdc5c-191b-4429-8c18-6bf9036b4ef4. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:19:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-f86f23f6-2631-40cd-a4ce-0022dac83bc1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-f86f23f6-2631-40cd-a4ce-0022dac83bc1-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-quobyte-f86f23f6-2631-40cd-a4ce-0022dac83bc1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:19:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-f86f23f6-2631-40cd-a4ce-0022dac83bc1" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:19:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f30ba7c-d431-4b57-b598-b45d1edbbf92]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:19:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:56 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 Sep 28 16:19:56 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:57 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1" returned: 0 in 1.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:57 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1 Sep 28 16:19:57 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:19:58 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f86f23f6-2631-40cd-a4ce-0022dac83bc1" returned: 0 in 1.010s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-f86f23f6-2631-40cd-a4ce-0022dac83bc1" released by "delete_volume" :: held 2.563s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:19:58 devstack cinder-volume[87150]: WARNING cinder.quota [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546407795-1809400510 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546407795-1809400510, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:19:58 devstack cinder-volume[87150]: WARNING cinder.quota [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546407795-1809400510 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-546407795-1809400510, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Created reservations ['21231224-d122-44dd-9195-99d00301e259', 'a5e4715f-c195-4671-b1ca-efc34315c03d', '554db371-2c6e-43bd-b3de-463c79334741', 'cdd73334-d8dd-4b0d-8193-e42354e87b8a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:19:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:19:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:19:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:19:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:19:59 devstack sudo[101137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:19:59 devstack sudo[101137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:00 devstack sudo[101137]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 1.071s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleted volume successfully. Sep 28 16:20:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a6cf65fa-066c-40b4-ba66-ea0908bcd308 tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-f86f23f6-2631-40cd-a4ce-0022dac83bc1-delete_volume" released by "delete_volume" :: held 4.337s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-0a637713-9ad2-40ea-a0ad-e5e7740bc117 req-c2c837ed-41e9-4ba5-9795-8e9070162325 tempest-TestInstancesWithCinderVolumes-2085933186 None] Terminate volume connection completed successfully. Sep 28 16:20:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-0a637713-9ad2-40ea-a0ad-e5e7740bc117 req-c2c837ed-41e9-4ba5-9795-8e9070162325 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleting attachment e577c94c-053a-43d1-9ea9-d20f47fc5644. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:20:05 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365" returned: 0 in 11.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:05 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c, size 1024.00 MB, duration 11.24 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:20:05 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Converted 1024.00 MB image at 91.10 MB/s Sep 28 16:20:05 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 is being set with open permissions: ugo+rw Sep 28 16:20:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:05 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 Sep 28 16:20:05 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-2461c835-033b-41e9-aa35-e3e8cd19a5a6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-2461c835-033b-41e9-aa35-e3e8cd19a5a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:06 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" released by "_copy_volume_from_snapshot" :: held 12.840s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-quobyte-717da5d3-97e5-4769-adc4-9ded1dbf3382" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-quobyte-2461c835-033b-41e9-aa35-e3e8cd19a5a6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-2461c835-033b-41e9-aa35-e3e8cd19a5a6" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-717da5d3-97e5-4769-adc4-9ded1dbf3382" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Deleting offline snapshot 717da5d3-97e5-4769-adc4-9ded1dbf3382 of volume e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] snapshot_file for this snap is: volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dbb5a8-4967-44ad-8a3c-288745f53cc7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4de63-640b-4f98-ae8b-5ef6e4c4ae82]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 Sep 28 16:20:06 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:20:06 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6" returned: 0 in 0.525s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:06 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6 Sep 28 16:20:06 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:06 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.588s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbfe16b-4c15-476e-8632-543c45964afb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:20:07 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2461c835-033b-41e9-aa35-e3e8cd19a5a6" returned: 0 in 0.322s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-2461c835-033b-41e9-aa35-e3e8cd19a5a6" released by "delete_volume" :: held 0.935s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:07 devstack cinder-volume[87150]: WARNING cinder.quota [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1974671389-645763293 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1974671389-645763293, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:20:07 devstack cinder-volume[87150]: WARNING cinder.quota [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1974671389-645763293 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1974671389-645763293, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Created reservations ['ee5a9f72-dfb7-4044-a181-7e8dfbc14e04', 'de7bfdb0-6b90-47ac-bfba-ae3fad576d65', '0c91aea4-7818-4457-9291-8345aaaf4104', 'a9d04542-86b1-4c52-8ae5-b50cbc3c9451'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:07 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.719s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:07 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:20:07 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:07 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleted volume successfully. Sep 28 16:20:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c8325ce8-56b8-45ba-8c1a-c14431e6e93b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-2461c835-033b-41e9-aa35-e3e8cd19a5a6-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:08 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.506s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:08 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382 Sep 28 16:20:08 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:08 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c.717da5d3-97e5-4769-adc4-9ded1dbf3382" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-717da5d3-97e5-4769-adc4-9ded1dbf3382" released by "_delete_snapshot" :: held 2.418s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.357s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b1f7542-5d63-4726-bb84-4cbf7bac91b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fbaa95-ae5c-464a-beb6-e765233b7365', 'volume_size': 2, 'source_volid': 'e2199dde-45f0-4084-9c8f-fa83d74bec9c', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd510c2-2458-4eb4-90b5-d4895743a152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Volume volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 (b5fbaa95-ae5c-464a-beb6-e765233b7365): created successfully Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cd510c2-2458-4eb4-90b5-d4895743a152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Flow 'volume_create_manager' (47043584-e4e3-48ef-b9ed-ddad63096d16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4a53e755-6d3a-4659-8de9-243b38cd1b10 tempest-VolumesCloneTest-1777134440 None] Created volume successfully. Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-b5fbaa95-ae5c-464a-beb6-e765233b7365-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-b5fbaa95-ae5c-464a-beb6-e765233b7365-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" acquired by "delete_volume" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4308bf87-55ce-40e2-a3e6-068d7f3d7484]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:09 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 Sep 28 16:20:09 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365" returned: 0 in 0.790s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:10 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365 Sep 28 16:20:10 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:10 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5fbaa95-ae5c-464a-beb6-e765233b7365" returned: 0 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-b5fbaa95-ae5c-464a-beb6-e765233b7365" released by "delete_volume" :: held 1.286s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Created reservations ['30bdcd95-04c3-4d90-8c33-c7f728c1a949', '1990489a-8164-4084-8a9c-b4d88a1cb2b3', 'f3eccfc2-fadc-4cd9-a584-41e5be6e83a7', 'f11d7d66-2738-4bea-93ba-c50c77782771'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:11 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:11 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:11 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Deleted volume successfully. Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8879c523-8f3c-47b6-ae43-42d25fc56463 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-b5fbaa95-ae5c-464a-beb6-e765233b7365-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-e2199dde-45f0-4084-9c8f-fa83d74bec9c-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-e2199dde-45f0-4084-9c8f-fa83d74bec9c-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "cinder-quobyte-e2199dde-45f0-4084-9c8f-fa83d74bec9c" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-e2199dde-45f0-4084-9c8f-fa83d74bec9c" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666d526-c798-4f4b-91bc-6cf5584b56c7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack sudo[101289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:20:12 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-39f26edf-ab29-4336-b2b6-0a00d40a2417 req-db50a9e1-c721-4f24-a18f-889493b9c619 tempest-TestInstancesWithCinderVolumes-2085933186 None] Terminate volume connection completed successfully. Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-39f26edf-ab29-4336-b2b6-0a00d40a2417 req-db50a9e1-c721-4f24-a18f-889493b9c619 tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleting attachment 7bea214e-788d-485f-a7e7-8ee395eb8517. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:20:12 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.664s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:12 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c Sep 28 16:20:12 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:13 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e2199dde-45f0-4084-9c8f-fa83d74bec9c" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-quobyte-e2199dde-45f0-4084-9c8f-fa83d74bec9c" released by "delete_volume" :: held 1.184s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Created reservations ['3771b39b-e0f9-466b-b736-e6fffd8a803e', '895ef9ab-f39e-48e0-9124-1cbe1214465b', '7ea9e68f-0fe3-4c74-9c89-4cbec17f91a3', '3ae8a46b-c75c-4c49-8de3-509182149bf9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:13 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:13 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "cinder-quobyte-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d57dd3d-1fa8-4d72-ab94-92c48e8ff47c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:13 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Deleted volume successfully. Sep 28 16:20:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bf913be0-06c0-4733-9f3b-a50987bd6824 tempest-VolumesCloneTest-1777134440 None] Lock "cinder-e2199dde-45f0-4084-9c8f-fa83d74bec9c-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:13 devstack sudo[101306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b Sep 28 16:20:13 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:14 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:14 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b Sep 28 16:20:14 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:14 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" returned: 0 in 0.324s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-quobyte-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b" released by "delete_volume" :: held 0.813s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:14 devstack cinder-volume[87150]: WARNING cinder.quota [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876130859-1259652017 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876130859-1259652017, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:20:14 devstack cinder-volume[87150]: WARNING cinder.quota [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876130859-1259652017 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-876130859-1259652017, it is now deprecated. Please use the default quota class for default quota. Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Created reservations ['a19ef5a4-0e49-4a7a-96a1-04ba27a70f5e', 'b14b534d-a354-4ec7-951e-c0def6a58128', '711faaff-acfd-4a83-a620-49ca068b84e7', '111437f1-4b52-4207-a052-bf1ba86cf418'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:14 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:14 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:15 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Deleted volume successfully. Sep 28 16:20:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-09d31f0f-d0ca-4a48-b80c-aac49b2f7d0b tempest-TestInstancesWithCinderVolumes-2085933186 None] Lock "cinder-cedfb9ba-61a2-423d-93f6-94fe7f3cd97b-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-ae5ba7cb-db1c-4edd-9466-8ce111c365f4 req-6c52f0a5-1a06-4c7e-a2a8-e83d8a998224 tempest-TestShelveInstance-614320898 None] Terminate volume connection completed successfully. Sep 28 16:20:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-ae5ba7cb-db1c-4edd-9466-8ce111c365f4 req-6c52f0a5-1a06-4c7e-a2a8-e83d8a998224 tempest-TestShelveInstance-614320898 None] Deleting attachment 9280e5ed-3b49-4d19-ae43-0aa023641380. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Flow 'volume_create_manager' (a58e3fce-584f-4216-90c3-7f07e47c4f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4fb227-8e08-49af-b570-92c15e7d6026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4fb227-8e08-49af-b570-92c15e7d6026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1690062171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f77bb4-7b1b-4480-b22b-39da63751d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124b7f3862343daaef64d6198e9b6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:21Z,use_quota=True,user_id='a4f98a4a885343c68fea95f4d4944422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0d436c-5392-4ad2-b870-7e087e2a34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0d436c-5392-4ad2-b870-7e087e2a34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bb99f-7318-415d-a8ca-213eed3576cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (144bb99f-7318-415d-a8ca-213eed3576cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f77bb4-7b1b-4480-b22b-39da63751d20', 'volume_name': 'volume-04f77bb4-7b1b-4480-b22b-39da63751d20', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f05cad7-10e1-48f8-b346-085479e4e870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f05cad7-10e1-48f8-b346-085479e4e870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ef34b-f5db-4ac6-878d-41462ce61117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Volume 04f77bb4-7b1b-4480-b22b-39da63751d20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f77bb4-7b1b-4480-b22b-39da63751d20', 'volume_size': 2} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1690062171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f77bb4-7b1b-4480-b22b-39da63751d20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b124b7f3862343daaef64d6198e9b6f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:21Z,use_quota=True,user_id='a4f98a4a885343c68fea95f4d4944422',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Creating volume 04f77bb4-7b1b-4480-b22b-39da63751d20 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:20 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:20:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 2147483648 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:20 devstack sudo[101352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 2147483648 Sep 28 16:20:20 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:21 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 2147483648" returned: 0 in 0.805s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:21 devstack sudo[101359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 Sep 28 16:20:21 devstack sudo[101359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:22 devstack sudo[101359]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20" returned: 0 in 0.353s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d5ef34b-f5db-4ac6-878d-41462ce61117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f77bb4-7b1b-4480-b22b-39da63751d20', 'volume_size': 2}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c526e8b6-07e6-4506-b90f-93ab8a81999e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Volume volume-04f77bb4-7b1b-4480-b22b-39da63751d20 (04f77bb4-7b1b-4480-b22b-39da63751d20): created successfully Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c526e8b6-07e6-4506-b90f-93ab8a81999e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Flow 'volume_create_manager' (a58e3fce-584f-4216-90c3-7f07e47c4f5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7587c754-6c81-4815-9221-1bc25eb62705 tempest-VolumesCloneNegativeTest-64584636 None] Created volume successfully. Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Acquiring lock "cinder-04f77bb4-7b1b-4480-b22b-39da63751d20-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "cinder-04f77bb4-7b1b-4480-b22b-39da63751d20-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f4192ffe-d685-41f0-959f-f347d63f5e8b req-0567fcc8-405b-4d6c-91ab-3d8fb6ee331f tempest-TestShelveInstance-614320898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f4192ffe-d685-41f0-959f-f347d63f5e8b req-0567fcc8-405b-4d6c-91ab-3d8fb6ee331f tempest-TestShelveInstance-614320898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-f4192ffe-d685-41f0-959f-f347d63f5e8b req-0567fcc8-405b-4d6c-91ab-3d8fb6ee331f tempest-TestShelveInstance-614320898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Acquiring lock "cinder-quobyte-04f77bb4-7b1b-4480-b22b-39da63751d20" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "cinder-quobyte-04f77bb4-7b1b-4480-b22b-39da63751d20" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-f4192ffe-d685-41f0-959f-f347d63f5e8b req-0567fcc8-405b-4d6c-91ab-3d8fb6ee331f tempest-TestShelveInstance-614320898 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-f2eac24d-4b7c-4750-8790-f7ead589eb78', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac4ad345-9925-489e-a408-2f576ba1c032', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d6f5d3-5975-454a-9546-7079d855b069]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-f4192ffe-d685-41f0-959f-f347d63f5e8b req-0567fcc8-405b-4d6c-91ab-3d8fb6ee331f tempest-TestShelveInstance-614320898 None] attachment_update completed successfully. Sep 28 16:20:23 devstack sudo[101373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 Sep 28 16:20:23 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:23 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20" returned: 0 in 0.533s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:23 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20 Sep 28 16:20:23 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04f77bb4-7b1b-4480-b22b-39da63751d20" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "cinder-quobyte-04f77bb4-7b1b-4480-b22b-39da63751d20" released by "delete_volume" :: held 1.062s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Created reservations ['747323da-5d6e-4a68-a562-3fc7b3886e49', 'd9090c90-cbf0-436d-86db-d0fd31a2094d', 'c45e9c31-7975-4774-9f0e-7369cac3618b', 'c49166c4-8173-495d-83bc-d312db1a88ec'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:24 devstack sudo[101381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:24 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:24 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Deleted volume successfully. Sep 28 16:20:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c75c3366-0f28-4a6d-9a6c-9bd51ac1d8c4 tempest-VolumesCloneNegativeTest-64584636 None] Lock "cinder-04f77bb4-7b1b-4480-b22b-39da63751d20-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (b31aa28e-41ac-4d8a-829f-5156f24bff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0456339b-5f25-4de1-8681-d839e3521444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0456339b-5f25-4de1-8681-d839e3521444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494899810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007bd2b-9eb1-4167-80c5-7a1b87721776,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:32Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52369957-fe88-40ec-aab4-ef8301a44991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52369957-fe88-40ec-aab4-ef8301a44991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1833f6-f79b-497b-8ef8-ac29631c299f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1833f6-f79b-497b-8ef8-ac29631c299f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a007bd2b-9eb1-4167-80c5-7a1b87721776', 'volume_name': 'volume-a007bd2b-9eb1-4167-80c5-7a1b87721776', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c860705d-384e-4880-936d-2370ab01b852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c860705d-384e-4880-936d-2370ab01b852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae0183-9a46-4e48-8f94-c94d8c4f0a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Volume a007bd2b-9eb1-4167-80c5-7a1b87721776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a007bd2b-9eb1-4167-80c5-7a1b87721776', 'volume_size': 1} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-494899810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a007bd2b-9eb1-4167-80c5-7a1b87721776,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:32Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Creating volume a007bd2b-9eb1-4167-80c5-7a1b87721776 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:20:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:32 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 1073741824 Sep 28 16:20:32 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:33 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 1073741824" returned: 0 in 0.725s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:33 devstack sudo[101891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 Sep 28 16:20:33 devstack sudo[101891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:33 devstack sudo[101891]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cae0183-9a46-4e48-8f94-c94d8c4f0a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a007bd2b-9eb1-4167-80c5-7a1b87721776', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30db7ae0-9c03-4f54-8472-982a8c4f986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Volume volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 (a007bd2b-9eb1-4167-80c5-7a1b87721776): created successfully Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30db7ae0-9c03-4f54-8472-982a8c4f986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (b31aa28e-41ac-4d8a-829f-5156f24bff28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0df9d2be-d8ea-4b6e-b387-f01fb2831c98 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (fbc28a97-f835-4b7d-a728-46efa555192d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c30e865-8fbf-430c-b0e8-bc25e763f499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c30e865-8fbf-430c-b0e8-bc25e763f499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1745810747',display_name='tempest-VolumesGetTest-Volume-156635637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f2695-65e8-4c35-8c01-0774c1d519ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:36Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f14a51a-6b6b-4c37-8e6f-635c550e9ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f14a51a-6b6b-4c37-8e6f-635c550e9ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51043d2-4cb8-4a30-b4a6-5bdd2b3e6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d51043d2-4cb8-4a30-b4a6-5bdd2b3e6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '627f2695-65e8-4c35-8c01-0774c1d519ad', 'volume_name': 'volume-627f2695-65e8-4c35-8c01-0774c1d519ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7947bd6c-4159-49ce-84f6-6fee3d7e802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7947bd6c-4159-49ce-84f6-6fee3d7e802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de810fc-dac2-412e-abf7-4c48c8399899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Volume 627f2695-65e8-4c35-8c01-0774c1d519ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-627f2695-65e8-4c35-8c01-0774c1d519ad', 'volume_size': 1} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1745810747',display_name='tempest-VolumesGetTest-Volume-156635637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=627f2695-65e8-4c35-8c01-0774c1d519ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:36Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Creating volume 627f2695-65e8-4c35-8c01-0774c1d519ad {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:36 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:36 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad 1073741824 Sep 28 16:20:36 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:36 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:36 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:36 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:20:37 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad 1073741824" returned: 0 in 0.816s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:37 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad Sep 28 16:20:37 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:37 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad" returned: 0 in 0.473s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de810fc-dac2-412e-abf7-4c48c8399899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-627f2695-65e8-4c35-8c01-0774c1d519ad', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9dbba7-69f2-41c3-ad80-d12b0ebc9f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:37 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Volume volume-627f2695-65e8-4c35-8c01-0774c1d519ad (627f2695-65e8-4c35-8c01-0774c1d519ad): created successfully Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f9dbba7-69f2-41c3-ad80-d12b0ebc9f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (fbc28a97-f835-4b7d-a728-46efa555192d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5cdd129d-5e8b-48d5-bb70-eb38d7f5b5f8 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-627f2695-65e8-4c35-8c01-0774c1d519ad-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "cinder-627f2695-65e8-4c35-8c01-0774c1d519ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-627f2695-65e8-4c35-8c01-0774c1d519ad" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-627f2695-65e8-4c35-8c01-0774c1d519ad" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2266a3-a8ad-4054-b618-8773e1f5a647]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:38 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad Sep 28 16:20:38 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad" returned: 0 in 0.497s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad Sep 28 16:20:39 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:39 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-627f2695-65e8-4c35-8c01-0774c1d519ad" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-627f2695-65e8-4c35-8c01-0774c1d519ad" released by "delete_volume" :: held 0.910s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Created reservations ['77bef5fc-0de6-478e-b46b-eaadc0d4866a', '20b7bbfc-7cf3-47df-ab0f-d4676f873c0d', '2437f99a-e28d-422b-86b8-120ed2ae6a39', 'b9028cdb-653a-4c16-b89b-f2acd339bb50'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:39 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:39 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:40 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0bf3b1a-87ea-4568-8f64-55f9d8f9c404 tempest-VolumesGetTest-2107150974 None] Lock "cinder-627f2695-65e8-4c35-8c01-0774c1d519ad-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-a007bd2b-9eb1-4167-80c5-7a1b87721776-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "cinder-a007bd2b-9eb1-4167-80c5-7a1b87721776-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=74,cinder:UPDATE=78,cinder:INSERT=14,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=71,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-a007bd2b-9eb1-4167-80c5-7a1b87721776" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-a007bd2b-9eb1-4167-80c5-7a1b87721776" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e983676c-b0cb-494a-b99d-5248c82d84ff]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:41 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 Sep 28 16:20:41 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:41 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:41 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776 Sep 28 16:20:41 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:42 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a007bd2b-9eb1-4167-80c5-7a1b87721776" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-a007bd2b-9eb1-4167-80c5-7a1b87721776" released by "delete_volume" :: held 0.963s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Created reservations ['c30a509a-0e6d-49fc-81d9-90bb84b31106', 'f0378789-ed30-41db-99ab-bc3ea820ddec', 'cf59a7b6-63e7-44ec-97a8-400593c5b22e', '4a364586-198f-4f50-9da1-d6c49fa4bfb5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:42 devstack sudo[101926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:20:42 devstack sudo[101926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:42 devstack sudo[101926]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:20:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:20:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-62cc31fd-42a8-4b8a-ae49-1368c9496598 tempest-VolumesGetTest-2107150974 None] Lock "cinder-a007bd2b-9eb1-4167-80c5-7a1b87721776-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (dde8cc9c-170c-40a8-8396-dff82f981278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dcfabd-95a3-49fe-a149-a739d14d0cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3dcfabd-95a3-49fe-a149-a739d14d0cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1146407591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d23f59b-1829-450d-8c56-3965d3e46f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:44Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edbffff-521b-499a-974b-e76736b61d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0edbffff-521b-499a-974b-e76736b61d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10276fd3-dc35-4b82-94b8-d2b102da581d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10276fd3-dc35-4b82-94b8-d2b102da581d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d23f59b-1829-450d-8c56-3965d3e46f5e', 'volume_name': 'volume-5d23f59b-1829-450d-8c56-3965d3e46f5e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ac1c23-faa8-4267-bd4d-0e9822b57020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ac1c23-faa8-4267-bd4d-0e9822b57020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3082a5c8-9d12-4ba0-88b4-da9d3d067581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Volume 5d23f59b-1829-450d-8c56-3965d3e46f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d23f59b-1829-450d-8c56-3965d3e46f5e', 'volume_size': 1} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1146407591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d23f59b-1829-450d-8c56-3965d3e46f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:44Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Creating volume 5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:20:44 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:20:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:44 devstack sudo[101929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e 1073741824 Sep 28 16:20:44 devstack sudo[101929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:45 devstack sudo[101929]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e 1073741824" returned: 0 in 0.981s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:45 devstack sudo[101935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:20:45 devstack sudo[101935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:45 devstack sudo[101935]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3082a5c8-9d12-4ba0-88b4-da9d3d067581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d23f59b-1829-450d-8c56-3965d3e46f5e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab25f21-3edb-424a-a0a5-f24282f10cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Volume volume-5d23f59b-1829-450d-8c56-3965d3e46f5e (5d23f59b-1829-450d-8c56-3965d3e46f5e): created successfully Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab25f21-3edb-424a-a0a5-f24282f10cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (dde8cc9c-170c-40a8-8396-dff82f981278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dfc277c8-dbe0-4d4e-8d85-4dcc7145b805 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (d8dd7701-dfc6-4837-8983-c7de0773e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa11b22-9154-4e8d-8ba8-df7ef9ee1926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aa11b22-9154-4e8d-8ba8-df7ef9ee1926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-362968248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=5d23f59b-1829-450d-8c56-3965d3e46f5e,status='creating',terminated_at=None,updated_at=2026-09-28T14:20:47Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e425a7e-d215-4eaa-9f8a-78ef96951c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e425a7e-d215-4eaa-9f8a-78ef96951c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7c830-cb16-40cf-8fe4-b296e60f71dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa7c830-cb16-40cf-8fe4-b296e60f71dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3', 'volume_name': 'volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3', 'volume_size': 1, 'source_volid': '5d23f59b-1829-450d-8c56-3965d3e46f5e', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cdb76d-b4f9-4a88-a904-c87a33bac0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34cdb76d-b4f9-4a88-a904-c87a33bac0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc1d8b5-4909-4e73-b4dd-0dcb79a998fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:20:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Volume 9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3', 'volume_size': 1, 'source_volid': '5d23f59b-1829-450d-8c56-3965d3e46f5e', 'source_volstatus': 'available'} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:47 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Cloning volume 5d23f59b-1829-450d-8c56-3965d3e46f5e to volume 9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Creating offline snapshot 25c781da-0973-42f4-a7a1-18b6b7ebf708 of volume 5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34720834-42a4-4907-8ddb-ad1478cadd5c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:47 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:20:47 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:48 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.594s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:48 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 1G Sep 28 16:20:48 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:48 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 1G" returned: 0 in 0.582s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d23f59b-1829-450d-8c56-3965d3e46f5e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:48 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d23f59b-1829-450d-8c56-3965d3e46f5e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:20:48 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:49 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d23f59b-1829-450d-8c56-3965d3e46f5e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:49 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 is being set with open permissions: ugo+rw Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:49 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:20:49 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:49 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:49 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info Sep 28 16:20:49 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:49 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:49 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info is being set with open permissions: ugo+rw Sep 28 16:20:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:49 devstack sudo[101997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info Sep 28 16:20:49 devstack sudo[101997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:50 devstack sudo[101997]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.info" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] snapshot: 25c781da-0973-42f4-a7a1-18b6b7ebf708, volume: 9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff920c6-8fc7-4a39-87bd-4f0f6dee7f81]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:50 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:20:50 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:50 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d23f59b-1829-450d-8c56-3965d3e46f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b72c8fe-39f5-4c9a-845e-34c682b92d79]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:20:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:50 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:20:50 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:51 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 28 16:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.437s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:20:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:20:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:20:51 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:20:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:20:51 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 Sep 28 16:20:51 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:20:59 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=14,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:20:59 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=7,cinder:INSERT=4,cinder:UPDATE=9 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:21:00 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" returned: 0 in 8.923s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e, size 1024.00 MB, duration 8.93 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:21:00 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Converted 1024.00 MB image at 114.73 MB/s Sep 28 16:21:00 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 is being set with open permissions: ugo+rw Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:00 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 Sep 28 16:21:00 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:00 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" released by "_copy_volume_from_snapshot" :: held 10.183s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-25c781da-0973-42f4-a7a1-18b6b7ebf708" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-25c781da-0973-42f4-a7a1-18b6b7ebf708" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Deleting offline snapshot 25c781da-0973-42f4-a7a1-18b6b7ebf708 of volume 5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] snapshot_file for this snap is: volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[727a6738-c494-482a-bca2-5604224e05b8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:00 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:21:00 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:00 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d23f59b-1829-450d-8c56-3965d3e46f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68f3280-1091-401b-a57b-637bc8889151]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:01 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:21:01 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:01 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.746s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:01 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:21:01 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:02 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:02 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708 Sep 28 16:21:02 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:02 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e.25c781da-0973-42f4-a7a1-18b6b7ebf708" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-25c781da-0973-42f4-a7a1-18b6b7ebf708" released by "_delete_snapshot" :: held 2.307s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.295s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dc1d8b5-4909-4e73-b4dd-0dcb79a998fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3', 'volume_size': 1, 'source_volid': '5d23f59b-1829-450d-8c56-3965d3e46f5e', 'source_volstatus': 'available'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7eef42-761f-4ef9-ba9e-98620c6b9f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Volume volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 (9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3): created successfully Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e7eef42-761f-4ef9-ba9e-98620c6b9f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (d8dd7701-dfc6-4837-8983-c7de0773e078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9ae710cb-9d69-4c5c-9524-eea9242038d6 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (837333b6-04e3-448f-8555-82d5fb9e74a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfd53bb-0a0d-4224-9c5d-adee8502dbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dfd53bb-0a0d-4224-9c5d-adee8502dbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208353197',display_name='tempest-VolumesGetTest-Volume-1653086443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70998bbc-dd78-4af1-9fd2-dc2e2869c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:05Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f86e65-fd23-4206-8e71-03ccfcddd0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f86e65-fd23-4206-8e71-03ccfcddd0bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca21706-4c51-4a38-89ab-2fb43de09219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cca21706-4c51-4a38-89ab-2fb43de09219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70998bbc-dd78-4af1-9fd2-dc2e2869c026', 'volume_name': 'volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4695de2-0753-42bf-9d77-413a3679b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4695de2-0753-42bf-9d77-413a3679b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60c3316-3adf-4cf5-ba56-a3177cbdb6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Volume 70998bbc-dd78-4af1-9fd2-dc2e2869c026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026', 'volume_size': 1} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-208353197',display_name='tempest-VolumesGetTest-Volume-1653086443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70998bbc-dd78-4af1-9fd2-dc2e2869c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:05Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Creating volume 70998bbc-dd78-4af1-9fd2-dc2e2869c026 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:05 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:05 devstack sudo[102056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 1073741824 Sep 28 16:21:05 devstack sudo[102056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:05 devstack sudo[102056]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 1073741824" returned: 0 in 0.686s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:05 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 Sep 28 16:21:05 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:06 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026" returned: 0 in 0.405s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60c3316-3adf-4cf5-ba56-a3177cbdb6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6104bd64-7408-47ff-9a18-b47a4e09ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Volume volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 (70998bbc-dd78-4af1-9fd2-dc2e2869c026): created successfully Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6104bd64-7408-47ff-9a18-b47a4e09ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (837333b6-04e3-448f-8555-82d5fb9e74a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2da9a099-83f2-45a5-be71-855d80b9a245 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-70998bbc-dd78-4af1-9fd2-dc2e2869c026-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-70998bbc-dd78-4af1-9fd2-dc2e2869c026-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-70998bbc-dd78-4af1-9fd2-dc2e2869c026" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-70998bbc-dd78-4af1-9fd2-dc2e2869c026" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9581e058-ad5f-4e53-9a33-91bf278b7a0d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:07 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 Sep 28 16:21:07 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:08 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026" returned: 0 in 0.609s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:08 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026 Sep 28 16:21:08 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:08 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-70998bbc-dd78-4af1-9fd2-dc2e2869c026" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-70998bbc-dd78-4af1-9fd2-dc2e2869c026" released by "delete_volume" :: held 1.057s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Created reservations ['a86be0bd-260c-4b06-a45a-24b101ed5a10', '1fe04354-c3c4-4025-b4c6-f2a8487fc237', '7e513678-7796-4931-b49d-af466f291346', '4fc4af86-ef82-4039-9364-34eb37e137b2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:08 devstack sudo[102119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:08 devstack sudo[102119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:09 devstack sudo[102119]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bd752a0f-1b03-4f3b-9f3c-efa3512c2bc6 tempest-VolumesGetTest-2107150974 None] Lock "cinder-70998bbc-dd78-4af1-9fd2-dc2e2869c026-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "cinder-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:09 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aab0bc1-a464-490e-b7e7-68fbe7c0b297]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:10 devstack sudo[102138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 Sep 28 16:21:10 devstack sudo[102138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:10 devstack sudo[102138]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" returned: 0 in 0.640s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:10 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3 Sep 28 16:21:10 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:11 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" returned: 0 in 0.473s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3" released by "delete_volume" :: held 1.208s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Created reservations ['e491236e-9803-4513-b828-ed9eb3425e4f', '18ca6c5e-3d66-4ba9-9dc3-4cba19ddf7ca', '2d75fd45-771f-440b-8710-88aa8341820a', 'ec070103-34b8-4155-89e6-6585e1527a85'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:11 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:11 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-1b9d32f9-52b3-48d1-9605-2957b1e742be tempest-TestShelveInstance-614320898 None] Terminate volume connection completed successfully. Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-1b9d32f9-52b3-48d1-9605-2957b1e742be tempest-TestShelveInstance-614320898 None] Deleting attachment ac4ad345-9925-489e-a408-2f576ba1c032. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:21:11 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.334s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02bea33-ed2b-40ba-bb7d-a96a5747b72e tempest-VolumesGetTest-2107150974 None] Lock "cinder-9ad9b90f-9cdb-44c7-b47d-22bf5331e5a3-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Acquiring lock "cinder-f2eac24d-4b7c-4750-8790-f7ead589eb78-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "cinder-f2eac24d-4b7c-4750-8790-f7ead589eb78-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Acquiring lock "cinder-quobyte-f2eac24d-4b7c-4750-8790-f7ead589eb78" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "cinder-quobyte-f2eac24d-4b7c-4750-8790-f7ead589eb78" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4b20b5-3be5-48b5-82e8-2f61662da50b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 Sep 28 16:21:12 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-5d23f59b-1829-450d-8c56-3965d3e46f5e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "cinder-5d23f59b-1829-450d-8c56-3965d3e46f5e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-5d23f59b-1829-450d-8c56-3965d3e46f5e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-5d23f59b-1829-450d-8c56-3965d3e46f5e" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5615b6f9-ad6b-4d0c-8a8f-9db1442140b1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78" returned: 0 in 0.603s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:12 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78 Sep 28 16:21:12 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:21:12 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:12 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f2eac24d-4b7c-4750-8790-f7ead589eb78" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "cinder-quobyte-f2eac24d-4b7c-4750-8790-f7ead589eb78" released by "delete_volume" :: held 1.016s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.quota [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Created reservations ['142b16eb-47f7-4f19-a8d2-3b91d78ec8f4', '2a92d64e-db5f-4666-ba7a-45f13a39ab9b', '30c0b154-fb1e-4e13-a9f6-14262f5db318', '6b009ce5-74ef-4ed8-bbb5-9492b6dfbf0a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:13 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e Sep 28 16:21:13 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:13 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:13 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5d23f59b-1829-450d-8c56-3965d3e46f5e" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-5d23f59b-1829-450d-8c56-3965d3e46f5e" released by "delete_volume" :: held 0.990s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.manager [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Created reservations ['3deff4c4-1f5e-4a65-9bf4-803f488560be', '7e4c5d32-df74-476c-a218-cb0a146874fb', 'a0f65088-7344-4ce5-a721-db07ac476861', '57f72ed1-771d-4158-a2c5-180db776d7dc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Deleted volume successfully. Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [req-704cb1c7-060f-4941-818e-7dde37f8cee5 req-c361a991-71e4-41ec-9032-7d81c00184b0 tempest-TestShelveInstance-614320898 None] Lock "cinder-f2eac24d-4b7c-4750-8790-f7ead589eb78-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:13 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:13 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:14 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:14 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:21:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d680ed0f-21ea-4039-bcbf-6bf889a8a07f tempest-VolumesGetTest-2107150974 None] Lock "cinder-5d23f59b-1829-450d-8c56-3965d3e46f5e-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (bb6f1fd4-13b9-4c84-8849-36152ab58905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41e1989-1e23-487f-b262-32e74968e89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41e1989-1e23-487f-b262-32e74968e89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-555944711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8e0393-f7a1-4274-b925-305c5d534b48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:16Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda8f5bc-d468-460d-9937-25a04acad3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda8f5bc-d468-460d-9937-25a04acad3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4624458d-d0b7-4b9f-b51b-e1f9aa2c9a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:15 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4624458d-d0b7-4b9f-b51b-e1f9aa2c9a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fc8e0393-f7a1-4274-b925-305c5d534b48', 'volume_name': 'volume-fc8e0393-f7a1-4274-b925-305c5d534b48', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99544470-20ee-48ac-a124-80ce98cbb5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99544470-20ee-48ac-a124-80ce98cbb5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a66bb7-1c0a-4d2f-9b37-041186ece2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Volume fc8e0393-f7a1-4274-b925-305c5d534b48: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fc8e0393-f7a1-4274-b925-305c5d534b48', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Trying to clone fc8e0393-f7a1-4274-b925-305c5d534b48 from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b at location (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:21:16 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:21:16 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Image download 20.69 MB at 20.69 MB/s Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a9ab98-13e4-40c4-9211-fd7bce06f26e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:17 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD Sep 28 16:21:17 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:17 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b is fetched for user 58304256d13a481f823c5bc567ead05c. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f26929-eb99-4367-aefe-d6ade2384414]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:17 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD Sep 28 16:21:17 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:18 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-555944711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc8e0393-f7a1-4274-b925-305c5d534b48,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:16Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Creating volume fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:18 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:18 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1073741824 Sep 28 16:21:18 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:18 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1073741824" returned: 0 in 0.751s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:19 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 Sep 28 16:21:19 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:19 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Attempting download of 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume fc8e0393-f7a1-4274-b925-305c5d534b48. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[16883c06-d116-45c9-a736-9809c825b9ca]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:19 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd Sep 28 16:21:19 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:20 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:20 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd Sep 28 16:21:20 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:20 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd" returned: 1 in 0.469s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4199de88-fb3b-44ba-ad33-1430d8c72a6b_8fiivprd' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aada5a7-ee3b-4bb6-8b78-82ab5ae90070]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:20 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD Sep 28 16:21:20 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:21 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:21 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] 4199de88-fb3b-44ba-ad33-1430d8c72a6b was qcow2, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:21:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:21 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 Sep 28 16:21:21 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48" returned: 0 in 3.772s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4199de88-fb3b-44ba-ad33-1430d8c72a6b_gka3ele1devstack@QuobyteHD, size 112.00 MB, duration 3.77 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:21:25 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Converted 112.00 MB image at 29.68 MB/s Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:25 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1G Sep 28 16:21:25 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:25 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 1G" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Downloaded image 4199de88-fb3b-44ba-ad33-1430d8c72a6b ((None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}])) to volume fc8e0393-f7a1-4274-b925-305c5d534b48 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Temporary image 4199de88-fb3b-44ba-ad33-1430d8c72a6b for user 58304256d13a481f823c5bc567ead05c is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Marking volume fc8e0393-f7a1-4274-b925-305c5d534b48 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Copying metadata from image 4199de88-fb3b-44ba-ad33-1430d8c72a6b to fc8e0393-f7a1-4274-b925-305c5d534b48. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Creating volume glance metadata for volume fc8e0393-f7a1-4274-b925-305c5d534b48 backed by image 4199de88-fb3b-44ba-ad33-1430d8c72a6b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a66bb7-1c0a-4d2f-9b37-041186ece2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc8e0393-f7a1-4274-b925-305c5d534b48', 'volume_size': 1, 'image_id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '717e8b9cffa841048ee794e829355b68', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4199de88-fb3b-44ba-ad33-1430d8c72a6b', 'created_at': datetime.datetime(2026, 9, 28, 13, 56, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 13, 56, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4199de88-fb3b-44ba-ad33-1430d8c72a6b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335215e5-ed87-4c59-ab9b-41e73d07b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Volume volume-fc8e0393-f7a1-4274-b925-305c5d534b48 (fc8e0393-f7a1-4274-b925-305c5d534b48): created successfully Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (335215e5-ed87-4c59-ab9b-41e73d07b151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (bb6f1fd4-13b9-4c84-8849-36152ab58905) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ee421faf-5efa-4670-8b4b-235241d23451 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (14fcfcb2-59ff-4ec2-9ed7-3c8d7f972373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8a9e1d-db3f-4c2e-b714-942ea400ce29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8a9e1d-db3f-4c2e-b714-942ea400ce29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382312961',display_name='tempest-VolumesGetTest-Volume-338530622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd342496-5ed0-4126-a48d-35c04b574b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:29Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b79a338-347c-4009-9170-d9a13fb3ba7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b79a338-347c-4009-9170-d9a13fb3ba7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a379fd1d-2c11-4dec-a487-8f475325953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a379fd1d-2c11-4dec-a487-8f475325953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd342496-5ed0-4126-a48d-35c04b574b8a', 'volume_name': 'volume-bd342496-5ed0-4126-a48d-35c04b574b8a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd9f140-0c92-4c6a-81f0-13bb5164d889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebd9f140-0c92-4c6a-81f0-13bb5164d889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68c66e-d7ba-464a-9de7-65d090c7d8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Volume bd342496-5ed0-4126-a48d-35c04b574b8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd342496-5ed0-4126-a48d-35c04b574b8a', 'volume_size': 1} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382312961',display_name='tempest-VolumesGetTest-Volume-338530622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd342496-5ed0-4126-a48d-35c04b574b8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1f4360763894b55b0dd988c3a0ee1ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:29Z,use_quota=True,user_id='58304256d13a481f823c5bc567ead05c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Creating volume bd342496-5ed0-4126-a48d-35c04b574b8a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:28 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a 1073741824 Sep 28 16:21:28 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Flow 'volume_create_manager' (062e5cbc-6176-4f05-a678-6d02454457a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c201293-94ba-4b46-b624-bb2e838da367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c201293-94ba-4b46-b624-bb2e838da367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-445083890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b65e341d174c3f80e7ad67044bf78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:29Z,use_quota=True,user_id='e7f946a0f9314f40b7d7fc7044eaffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbaae4b-56cc-41db-91fd-df7258dd72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbaae4b-56cc-41db-91fd-df7258dd72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a7ae2-803b-4d38-b7bf-7609b5667c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (232a7ae2-803b-4d38-b7bf-7609b5667c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847', 'volume_name': 'volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed0b434-03c2-4319-9e7d-6e3be555187b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed0b434-03c2-4319-9e7d-6e3be555187b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89869067-26b7-4993-9f6c-e24d0b5b1edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Volume 7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847', 'volume_size': 1} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:29 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a 1073741824" returned: 0 in 0.599s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:29 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a Sep 28 16:21:29 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:29 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a" returned: 0 in 0.448s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.984s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-445083890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48b65e341d174c3f80e7ad67044bf78c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:29Z,use_quota=True,user_id='e7f946a0f9314f40b7d7fc7044eaffb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Creating volume 7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e68c66e-d7ba-464a-9de7-65d090c7d8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd342496-5ed0-4126-a48d-35c04b574b8a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:30 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 1073741824 Sep 28 16:21:30 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cebaa7-d4fa-492b-ab22-2ed92a8df3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Volume volume-bd342496-5ed0-4126-a48d-35c04b574b8a (bd342496-5ed0-4126-a48d-35c04b574b8a): created successfully Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37cebaa7-d4fa-492b-ab22-2ed92a8df3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Flow 'volume_create_manager' (14fcfcb2-59ff-4ec2-9ed7-3c8d7f972373) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b624116c-a079-4f65-8f4b-dd6b1f745298 tempest-VolumesGetTest-2107150974 None] Created volume successfully. Sep 28 16:21:30 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 1073741824" returned: 0 in 0.792s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-bd342496-5ed0-4126-a48d-35c04b574b8a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "cinder-bd342496-5ed0-4126-a48d-35c04b574b8a-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 Sep 28 16:21:31 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-bd342496-5ed0-4126-a48d-35c04b574b8a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-bd342496-5ed0-4126-a48d-35c04b574b8a" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbad8cc-4387-4350-828f-942cacc1e56c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[102373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a Sep 28 16:21:31 devstack sudo[102373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:31 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89869067-26b7-4993-9f6c-e24d0b5b1edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87051750-a5f4-4137-9c0a-7b55c2fba593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Volume volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 (7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847): created successfully Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87051750-a5f4-4137-9c0a-7b55c2fba593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Flow 'volume_create_manager' (062e5cbc-6176-4f05-a678-6d02454457a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4a5ccf47-b034-4eb7-9d69-f96fe45ac9b3 tempest-TestMinimumBasicScenario-631629713 None] Created volume successfully. Sep 28 16:21:31 devstack sudo[102373]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a" returned: 0 in 0.826s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:31 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a Sep 28 16:21:31 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:32 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-bd342496-5ed0-4126-a48d-35c04b574b8a" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-bd342496-5ed0-4126-a48d-35c04b574b8a" released by "delete_volume" :: held 1.453s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Created reservations ['e978a157-facc-4761-8bc7-b463bfb22b95', 'c1758479-52fc-43e5-8b43-073e4d65c81e', '19dfce33-d92b-49c2-a9df-12d19ee6c9ab', '20a78226-03f2-418f-84aa-b375fe727f8d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:32 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:32 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:33 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.630s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-17db18be-0f62-4d7d-b465-73f553490958 tempest-VolumesGetTest-2107150974 None] Lock "cinder-bd342496-5ed0-4126-a48d-35c04b574b8a-delete_volume" released by "delete_volume" :: held 2.591s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-fc8e0393-f7a1-4274-b925-305c5d534b48-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "cinder-fc8e0393-f7a1-4274-b925-305c5d534b48-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Acquiring lock "cinder-quobyte-fc8e0393-f7a1-4274-b925-305c5d534b48" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-fc8e0393-f7a1-4274-b925-305c5d534b48" acquired by "delete_volume" :: waited 0.063s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3fa525d5-0d4f-48db-bdea-128466f1ba27 req-50f8f282-bac9-4b56-913c-d1aa41a1a8b2 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3fa525d5-0d4f-48db-bdea-128466f1ba27 req-50f8f282-bac9-4b56-913c-d1aa41a1a8b2 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8012b8-4a0e-436c-a658-7379ebdf7b52]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-3fa525d5-0d4f-48db-bdea-128466f1ba27 req-50f8f282-bac9-4b56-913c-d1aa41a1a8b2 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.054s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-3fa525d5-0d4f-48db-bdea-128466f1ba27 req-50f8f282-bac9-4b56-913c-d1aa41a1a8b2 tempest-TestMinimumBasicScenario-631629713 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ffd34e0-e14f-48c7-9314-b50dfb0072ea', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:21:34 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 Sep 28 16:21:34 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-3fa525d5-0d4f-48db-bdea-128466f1ba27 req-50f8f282-bac9-4b56-913c-d1aa41a1a8b2 tempest-TestMinimumBasicScenario-631629713 None] attachment_update completed successfully. Sep 28 16:21:34 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48" returned: 0 in 0.771s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:34 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48 Sep 28 16:21:34 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fc8e0393-f7a1-4274-b925-305c5d534b48" returned: 0 in 0.520s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "cinder-quobyte-fc8e0393-f7a1-4274-b925-305c5d534b48" released by "delete_volume" :: held 1.391s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Created reservations ['f926a4cd-d61a-47b8-9149-3b984cbadeca', '12d674a8-6644-4232-8122-f60a59ebd7fa', 'ddfdcf87-0498-419b-bcf4-d4bc3f5805b6', '32d854ca-5623-449a-b129-b8ea006efe9e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:35 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:35 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:35 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.469s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Deleted volume successfully. Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-539fc80a-bdcf-4824-9a6d-c53ac4565d63 tempest-VolumesGetTest-2107150974 None] Lock "cinder-fc8e0393-f7a1-4274-b925-305c5d534b48-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:36 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:21:36 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:37 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.623s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:21:37 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:21:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Flow 'volume_create_manager' (28369000-1097-4551-a6c0-8d0417003bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a44e60-a321-47d7-9446-2ce190f5c662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42a44e60-a321-47d7-9446-2ce190f5c662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-912589720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c02105b-0d30-4f7b-9d3d-a98fd44c1278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab02463af2949ef8adb9b603730366c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:40Z,use_quota=True,user_id='10a1fa3e8af5437aafda5075d3c333d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c22867e-0f51-4370-bb8c-a42cddbeeddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c22867e-0f51-4370-bb8c-a42cddbeeddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd78904-98ee-413e-9bdf-ef941a086134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcd78904-98ee-413e-9bdf-ef941a086134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c02105b-0d30-4f7b-9d3d-a98fd44c1278', 'volume_name': 'volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2c5088-8290-4d14-8dca-ed8b59c19638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd2c5088-8290-4d14-8dca-ed8b59c19638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443651f8-6170-4ce3-8846-360bd72a072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Volume 6c02105b-0d30-4f7b-9d3d-a98fd44c1278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278', 'volume_size': 1} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-912589720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c02105b-0d30-4f7b-9d3d-a98fd44c1278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab02463af2949ef8adb9b603730366c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:40Z,use_quota=True,user_id='10a1fa3e8af5437aafda5075d3c333d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Creating volume 6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:39 devstack sudo[102850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 1073741824 Sep 28 16:21:39 devstack sudo[102850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[102850]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 1073741824" returned: 0 in 0.703s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:40 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:21:40 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:40 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (443651f8-6170-4ce3-8846-360bd72a072f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79a211-5b86-42ce-9d73-cbdcf2c813da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Volume volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 (6c02105b-0d30-4f7b-9d3d-a98fd44c1278): created successfully Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c79a211-5b86-42ce-9d73-cbdcf2c813da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Flow 'volume_create_manager' (28369000-1097-4551-a6c0-8d0417003bba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-12ff4f9a-e2a1-4d45-b33c-6fd152970538 tempest-VolumeDependencyTests-313282196 None] Created volume successfully. Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Creating offline snapshot cae383e3-ebc1-4fa4-b126-853116b0f46e of volume 6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f414cf3c-101f-4ea4-b648-fdbaf62310c1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:42 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:21:42 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:42 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.685s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:42 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e 1G Sep 28 16:21:42 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Flow 'volume_create_manager' (e2367f0b-8f39-474f-b44e-919363cc46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8957edd4-7a55-4df6-aa48-6758c33a18df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8957edd4-7a55-4df6-aa48-6758c33a18df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-948884278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c9839-24f0-4d1a-a0ea-50a5ca3ed155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69edd390c6774b6e9117b0053a1adc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:43Z,use_quota=True,user_id='cc8809c86031464aab1daa58f0db8793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28670eaf-8b8a-444b-b215-b4827d8999ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28670eaf-8b8a-444b-b215-b4827d8999ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cf22cb-df8f-412e-ae50-7f11df5c7228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06cf22cb-df8f-412e-ae50-7f11df5c7228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '738c9839-24f0-4d1a-a0ea-50a5ca3ed155', 'volume_name': 'volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83fc3-af26-4fd7-aad0-d763331df163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2e83fc3-af26-4fd7-aad0-d763331df163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dbda62-a90a-409b-8f69-44bb04dc36aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155', 'volume_size': 1} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:43 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e 1G" returned: 0 in 0.634s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:43 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:43 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:43 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.403s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:43 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e is being set with open permissions: ugo+rw Sep 28 16:21:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:43 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:43 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:44 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info Sep 28 16:21:44 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info" returned: 0 in 0.357s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info is being set with open permissions: ugo+rw Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:44 devstack sudo[102882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info Sep 28 16:21:44 devstack sudo[102882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:44 devstack sudo[102882]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.info" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.698s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-948884278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=738c9839-24f0-4d1a-a0ea-50a5ca3ed155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69edd390c6774b6e9117b0053a1adc64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:43Z,use_quota=True,user_id='cc8809c86031464aab1daa58f0db8793',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Creating volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:45 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:45 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 1073741824 Sep 28 16:21:45 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-03db1aa9-1e3d-4bd4-9d99-a79a8231a687 tempest-VolumeDependencyTests-313282196 None] Create snapshot completed successfully Sep 28 16:21:45 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 1073741824" returned: 0 in 0.596s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:45 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 Sep 28 16:21:45 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:45 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:45 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05dbda62-a90a-409b-8f69-44bb04dc36aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f939c-6e97-4be9-8365-ab7394f95fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Flow 'volume_create_manager' (b92c045f-c0cf-4c40-abf8-a92725b96449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5450fb26-3be1-4ec2-97ae-4557cb46ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5450fb26-3be1-4ec2-97ae-4557cb46ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-943500495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00752b35-f8b2-413c-bf9c-513bc8dd8505,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ab02463af2949ef8adb9b603730366c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:21:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cae383e3-ebc1-4fa4-b126-853116b0f46e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:21:46Z,use_quota=True,user_id='10a1fa3e8af5437aafda5075d3c333d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbb76de-9b19-4c17-9e79-76a9d7037c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fbb76de-9b19-4c17-9e79-76a9d7037c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2857cc-f3e4-40a2-af5d-45e6e077a318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2857cc-f3e4-40a2-af5d-45e6e077a318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00752b35-f8b2-413c-bf9c-513bc8dd8505', 'volume_name': 'volume-00752b35-f8b2-413c-bf9c-513bc8dd8505', 'volume_size': 1, 'snapshot_id': 'cae383e3-ebc1-4fa4-b126-853116b0f46e'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd3f2f-9f9b-4ce2-bf33-98bf69280a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6fd3f2f-9f9b-4ce2-bf33-98bf69280a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d475db0-07b0-4bd6-9d98-23b1347b40ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Volume 00752b35-f8b2-413c-bf9c-513bc8dd8505: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00752b35-f8b2-413c-bf9c-513bc8dd8505', 'volume_size': 1, 'snapshot_id': 'cae383e3-ebc1-4fa4-b126-853116b0f46e'} Sep 28 16:21:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Volume volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 (738c9839-24f0-4d1a-a0ea-50a5ca3ed155): created successfully Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536f939c-6e97-4be9-8365-ab7394f95fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Flow 'volume_create_manager' (e2367f0b-8f39-474f-b44e-919363cc46fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e-00752b35-f8b2-413c-bf9c-513bc8dd8505" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f1d16f93-7f38-4b5b-a9d5-eb6e11f4e801 tempest-VolumesSnapshotListTestJSON-300157117 None] Created volume successfully. Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e-00752b35-f8b2-413c-bf9c-513bc8dd8505" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Creating volume 00752b35-f8b2-413c-bf9c-513bc8dd8505 from snapshot cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] snapshot: cae383e3-ebc1-4fa4-b126-853116b0f46e, volume: 00752b35-f8b2-413c-bf9c-513bc8dd8505, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bb3046-2761-44a0-9505-d8faaf0f85a0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:46 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:46 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:21:47 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.702s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed62f9bb-89e2-4c5b-826d-b5aebb21cf0c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:47 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:21:47 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:47 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:21:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:47 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 Sep 28 16:21:47 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:55 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505" returned: 0 in 8.190s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:55 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278, size 1024.00 MB, duration 8.19 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:21:55 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Converted 1024.00 MB image at 125.00 MB/s Sep 28 16:21:55 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 is being set with open permissions: ugo+rw Sep 28 16:21:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:55 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 Sep 28 16:21:55 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:56 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" released by "_copy_volume_from_snapshot" :: held 9.844s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e-00752b35-f8b2-413c-bf9c-513bc8dd8505" released by "_create_volume_from_snapshot" :: held 9.958s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.528s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d475db0-07b0-4bd6-9d98-23b1347b40ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00752b35-f8b2-413c-bf9c-513bc8dd8505', 'volume_size': 1, 'snapshot_id': 'cae383e3-ebc1-4fa4-b126-853116b0f46e'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b40aa-0d6d-425a-b709-045c611ae559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Creating offline snapshot 7295a83c-c3a9-49e9-9912-7cdd3a787498 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:21:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Volume volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 (00752b35-f8b2-413c-bf9c-513bc8dd8505): created successfully Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db1b40aa-0d6d-425a-b709-045c611ae559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Flow 'volume_create_manager' (b92c045f-c0cf-4c40-abf8-a92725b96449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[726248a8-0d92-45b8-8f77-c652c15a6bfb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-92acda05-ffeb-4819-a28f-410739fa89da tempest-VolumeDependencyTests-313282196 None] Created volume successfully. Sep 28 16:21:56 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 Sep 28 16:21:56 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:56 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" returned: 0 in 0.558s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:56 devstack sudo[103001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 1G Sep 28 16:21:56 devstack sudo[103001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-cae383e3-ebc1-4fa4-b126-853116b0f46e-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-cae383e3-ebc1-4fa4-b126-853116b0f46e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Deleting offline snapshot cae383e3-ebc1-4fa4-b126-853116b0f46e of volume 6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] snapshot_file for this snap is: volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd102f3-b62a-4ece-b08c-a228b54b250b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:57 devstack sudo[103001]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 1G" returned: 0 in 0.678s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:57 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:57 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:57 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:21:57 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:57 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.493s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 is being set with open permissions: ugo+rw Sep 28 16:21:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:21:58 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.850s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf513916-7330-4da0-8ee5-4faa24d524b1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:21:58 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:58 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info Sep 28 16:21:58 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:58 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info" returned: 0 in 0.424s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info is being set with open permissions: ugo+rw Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:59 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info Sep 28 16:21:59 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.793s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:59 devstack sudo[103038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:59 devstack sudo[103038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.info" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.218s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:21:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8c746fad-99ad-4562-bdcf-915617b850ab tempest-VolumesSnapshotListTestJSON-300157117 None] Create snapshot completed successfully Sep 28 16:21:59 devstack sudo[103038]: pam_unix(sudo:session): session closed for user root Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.611s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:21:59 devstack sudo[103045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e Sep 28 16:21:59 devstack sudo[103045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:21:59 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=77,cinder:SELECT=66,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=82,cinder:INSERT=22,cinder:DELETE=8,cinder:SELECT=73 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Creating offline snapshot 2d406211-dcdc-4c90-97ec-c6629a3b0307 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:00 devstack sudo[103045]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278.cae383e3-ebc1-4fa4-b126-853116b0f46e" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c267338b-a195-420a-a17f-bdf18bbde6b1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-cae383e3-ebc1-4fa4-b126-853116b0f46e" released by "_delete_snapshot" :: held 2.938s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" released by "delete_snapshot" :: held 2.983s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Created reservations ['c2b5ff67-0569-4968-a60f-4680b12f60c3', 'afa62c69-24a3-4176-9697-ec2fec29ee17', '404695c9-0d47-4a08-962b-a42395c504cf', '08a9db8a-32e6-4d07-9a14-ab819626422c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:00 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:22:00 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Delete snapshot completed successfully. Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1f32af1e-5fca-4318-bd14-eb4868e2a3e3 tempest-VolumeDependencyTests-313282196 None] Lock "cinder-cae383e3-ebc1-4fa4-b126-853116b0f46e-delete_snapshot" released by "delete_snapshot" :: held 3.207s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-6c02105b-0d30-4f7b-9d3d-a98fd44c1278-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "cinder-6c02105b-0d30-4f7b-9d3d-a98fd44c1278-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d87885-e3f3-42dc-8ef3-eb2d4022c0f1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:00 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:00 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 1G Sep 28 16:22:00 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:00 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:22:00 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:01 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.520s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278 Sep 28 16:22:01 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:01 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 1G" returned: 0 in 0.693s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[103065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:01 devstack sudo[103065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:01 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" returned: 0 in 0.338s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-6c02105b-0d30-4f7b-9d3d-a98fd44c1278" released by "delete_volume" :: held 0.966s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Created reservations ['e18a0672-d435-4396-978a-52b5c4324fb8', '712520b5-a3bf-40bc-ac44-ba253e99225d', 'ddb52033-205e-4a94-bc73-a935d43aa280', '0368e2b8-9bcc-4936-ac69-edca33b080a6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:22:01 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:01 devstack sudo[103065]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 is being set with open permissions: ugo+rw Sep 28 16:22:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:01 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:01 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:02 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.313s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Deleted volume successfully. Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2120aba9-4348-45d5-85f6-b7b79322f55a tempest-VolumeDependencyTests-313282196 None] Lock "cinder-6c02105b-0d30-4f7b-9d3d-a98fd44c1278-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:02 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-65cb101a-e6f6-43a1-b9b1-781820d1db9d tempest-VolumesSnapshotListTestJSON-300157117 None] Create snapshot completed successfully Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-00752b35-f8b2-413c-bf9c-513bc8dd8505-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "cinder-00752b35-f8b2-413c-bf9c-513bc8dd8505-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Acquiring lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e62982-5d55-4256-83eb-35f1304364ac]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:03 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 Sep 28 16:22:03 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:03 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505" returned: 0 in 0.540s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:03 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505 Sep 28 16:22:03 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Creating offline snapshot 1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[07bed934-f52c-44ff-9f65-7c873a191273]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:03 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:03 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:03 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-00752b35-f8b2-413c-bf9c-513bc8dd8505" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "cinder-quobyte-00752b35-f8b2-413c-bf9c-513bc8dd8505" released by "delete_volume" :: held 0.996s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Created reservations ['f7123ca9-025c-40c4-bd31-18693e7c1369', 'cb6348aa-5ce2-46d7-9e82-a9a0db61ee39', 'aa73cb6b-96a5-4441-b0e3-713ed4e00e36', '81ddb301-e65d-403d-8cb7-54f067269d32'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:04 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.521s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:04 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:22:04 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:04 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 1G Sep 28 16:22:04 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:04 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Deleted volume successfully. Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a56e6a26-2221-4182-bb2e-06577ef55c3c tempest-VolumeDependencyTests-313282196 None] Lock "cinder-00752b35-f8b2-413c-bf9c-513bc8dd8505-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:04 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 1G" returned: 0 in 0.656s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:04 devstack sudo[103106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 Sep 28 16:22:04 devstack sudo[103106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:05 devstack sudo[103106]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" returned: 0 in 0.420s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:05 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 is being set with open permissions: ugo+rw Sep 28 16:22:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:05 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 Sep 28 16:22:05 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:05 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.117s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aee91603-3b5b-4975-aa80-a14b365a9aac tempest-VolumesSnapshotListTestJSON-300157117 None] Create snapshot completed successfully Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Deleting offline snapshot 1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] snapshot_file for this snap is: volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92726fe5-7c5f-4d74-aeab-9512a46c847a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:08 devstack sudo[103155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 Sep 28 16:22:08 devstack sudo[103155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:09 devstack sudo[103155]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" returned: 0 in 0.570s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8147c25c-642f-4e5e-9cbe-296008d95ca8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:09 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:09 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:09 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.566s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:09 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 Sep 28 16:22:09 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:10 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" returned: 0 in 0.622s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:10 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8 Sep 28 16:22:10 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:10 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" returned: 0 in 0.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8" released by "_delete_snapshot" :: held 2.268s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" released by "delete_snapshot" :: held 2.302s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Created reservations ['13d153d8-5638-4762-8f76-6d724d73d753', 'b51389e1-81d0-4eb2-8b81-e3f830bedab4', '7f8935c4-4b83-4565-8726-972486a1adae', '581a9fec-3de0-41c8-9d60-4f71486746ab'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Delete snapshot completed successfully. Sep 28 16:22:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a8938ea5-a40c-4d1b-90b6-87396a65062e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-1a9a02c0-ba62-4bc5-adef-ad9270b4f5e8-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-2d406211-dcdc-4c90-97ec-c6629a3b0307-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-2d406211-dcdc-4c90-97ec-c6629a3b0307-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-2d406211-dcdc-4c90-97ec-c6629a3b0307" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-2d406211-dcdc-4c90-97ec-c6629a3b0307" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Deleting offline snapshot 2d406211-dcdc-4c90-97ec-c6629a3b0307 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] snapshot_file for this snap is: volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b21522-d448-4a36-a6dd-0ef6fcb0896c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:11 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:11 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:12 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.592s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23173d42-6403-46a9-bc37-95c447bb8025]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:12 devstack sudo[103182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:22:12 devstack sudo[103182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:12 devstack sudo[103182]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:12 devstack sudo[103187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:12 devstack sudo[103187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:13 devstack sudo[103187]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.584s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:13 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307 Sep 28 16:22:13 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:13 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.2d406211-dcdc-4c90-97ec-c6629a3b0307" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-2d406211-dcdc-4c90-97ec-c6629a3b0307" released by "_delete_snapshot" :: held 2.252s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" released by "delete_snapshot" :: held 2.286s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Created reservations ['8e7f1c90-54ac-4b56-b849-b9f282e02762', '36a4442d-c641-48db-b7ce-648292f8a663', '9a42d30a-54d0-4fed-86bd-744c1bf5dbd3', '63119dd5-7ad1-4473-a419-0ba7f0073010'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Delete snapshot completed successfully. Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fd2dfe2f-9edf-4ac5-91d7-a1b75524875e tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-2d406211-dcdc-4c90-97ec-c6629a3b0307-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-7295a83c-c3a9-49e9-9912-7cdd3a787498-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-7295a83c-c3a9-49e9-9912-7cdd3a787498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-7295a83c-c3a9-49e9-9912-7cdd3a787498" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-7295a83c-c3a9-49e9-9912-7cdd3a787498" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Deleting offline snapshot 7295a83c-c3a9-49e9-9912-7cdd3a787498 of volume 738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:22:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] snapshot_file for this snap is: volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d12629a-a8df-47e8-8605-761d750efa82]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:15 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:22:15 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:15 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f7b8ac-1993-4bb0-9f69-037f79c1247a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:15 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 Sep 28 16:22:15 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:15 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" returned: 0 in 0.481s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:15 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:22:15 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:16 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.446s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:16 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498 Sep 28 16:22:16 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:16 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155.7295a83c-c3a9-49e9-9912-7cdd3a787498" returned: 0 in 0.343s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-7295a83c-c3a9-49e9-9912-7cdd3a787498" released by "_delete_snapshot" :: held 1.839s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" released by "delete_snapshot" :: held 1.867s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Created reservations ['e8e88409-26a2-43af-9c33-8f1d5b59ea8d', 'fa9deafb-7b73-4322-9e25-3bb8e53a1564', 'b022cd30-572a-4533-916a-6554079ad77e', '6f1c1bc8-9fad-49c5-a773-6305886392d9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Delete snapshot completed successfully. Sep 28 16:22:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-2c845172-5137-4289-8475-a935a2fce227 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-7295a83c-c3a9-49e9-9912-7cdd3a787498-delete_snapshot" released by "delete_snapshot" :: held 2.038s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-738c9839-24f0-4d1a-a0ea-50a5ca3ed155-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-738c9839-24f0-4d1a-a0ea-50a5ca3ed155-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3585e831-f852-486e-ae4b-b68ed514e119]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:17 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 Sep 28 16:22:17 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:17 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" returned: 0 in 0.495s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:17 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155 Sep 28 16:22:17 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:18 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" returned: 0 in 0.332s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-quobyte-738c9839-24f0-4d1a-a0ea-50a5ca3ed155" released by "delete_volume" :: held 0.940s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Created reservations ['558e4b31-350c-4177-8d11-a2ee91a30025', '919e550f-6f56-45a8-94fa-c14c820877e6', '77bde292-c15c-4b8e-9c26-7b8e00f9acf7', 'dc95c6ed-7cb4-47c6-98d3-8b5b18fec50c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:18 devstack sudo[103225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:22:18 devstack sudo[103225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:18 devstack sudo[103225]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Deleted volume successfully. Sep 28 16:22:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-80c1decc-7f1b-436e-a711-efda62436391 tempest-VolumesSnapshotListTestJSON-300157117 None] Lock "cinder-738c9839-24f0-4d1a-a0ea-50a5ca3ed155-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-96658a35-e382-4baa-8d99-efdf4ec863d0 req-5a5f3016-41da-4244-a9e2-55c753a61364 tempest-TestMinimumBasicScenario-631629713 None] Terminate volume connection completed successfully. Sep 28 16:22:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-96658a35-e382-4baa-8d99-efdf4ec863d0 req-5a5f3016-41da-4244-a9e2-55c753a61364 tempest-TestMinimumBasicScenario-631629713 None] Deleting attachment 2ffd34e0-e14f-48c7-9314-b50dfb0072ea. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:22:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "cinder-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "cinder-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "cinder-quobyte-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "cinder-quobyte-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d0a7a-18ce-4525-99eb-80a428ecd743]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 Sep 28 16:22:27 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:27 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" returned: 0 in 0.649s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:27 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847 Sep 28 16:22:27 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "cinder-quobyte-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847" released by "delete_volume" :: held 1.252s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Created reservations ['ed1f854d-1118-480b-ad41-fc98be070591', '0ecb0edc-4c9b-476e-8ea2-1bbcfa97a250', '3b2c262c-a000-410a-a93e-d7be6c8ffe46', '8638a7cc-bec6-400b-982f-2794fa224dac'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:28 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:22:28 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:28 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:29 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Deleted volume successfully. Sep 28 16:22:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0098cd7e-600f-4ec8-a042-c0b74bba5ee3 tempest-TestMinimumBasicScenario-631629713 None] Lock "cinder-7dc2f6ba-5ecf-4c9b-82ad-83a97ba80847-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:36 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:22:36 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:36 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.400s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:22:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:22:38 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=47,cinder:INSERT=18,cinder:UPDATE=55,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=44,cinder:INSERT=14,cinder:UPDATE=56,cinder:DELETE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:22:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Flow 'volume_create_manager' (f05aeb99-5192-4786-905f-8db0898e67c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f20f9-b269-4405-b8ae-b741dcffcae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4f20f9-b269-4405-b8ae-b741dcffcae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-69888706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd88e20-e62c-4c86-b478-c2e77252a2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9950912653403580edb6f156ef997c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='485ee86f4611414986d1a93c0e004de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40190b9d-a4f4-419e-b8de-207384aaf72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40190b9d-a4f4-419e-b8de-207384aaf72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d5629c-e2a8-4445-b8d5-a3ce902d233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d5629c-e2a8-4445-b8d5-a3ce902d233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd88e20-e62c-4c86-b478-c2e77252a2be', 'volume_name': 'volume-cfd88e20-e62c-4c86-b478-c2e77252a2be', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425ff49c-3a79-4102-8cf5-e4f7cfe1026b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425ff49c-3a79-4102-8cf5-e4f7cfe1026b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075b7b3a-ade6-4254-846d-6fb35b974b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Volume cfd88e20-e62c-4c86-b478-c2e77252a2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd88e20-e62c-4c86-b478-c2e77252a2be', 'volume_size': 1} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-69888706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd88e20-e62c-4c86-b478-c2e77252a2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9950912653403580edb6f156ef997c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:52Z,use_quota=True,user_id='485ee86f4611414986d1a93c0e004de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Creating volume cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:52 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:52 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be 1073741824 Sep 28 16:22:52 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:52 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be 1073741824" returned: 0 in 0.786s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:52 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:22:52 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:53 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (075b7b3a-ade6-4254-846d-6fb35b974b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd88e20-e62c-4c86-b478-c2e77252a2be', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505a1de-c620-46b1-91bd-c902e1ea4ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Volume volume-cfd88e20-e62c-4c86-b478-c2e77252a2be (cfd88e20-e62c-4c86-b478-c2e77252a2be): created successfully Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505a1de-c620-46b1-91bd-c902e1ea4ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Flow 'volume_create_manager' (f05aeb99-5192-4786-905f-8db0898e67c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c5484b14-f2d1-4fe9-b1a6-84b1894bfb74 tempest-SnapshotDependencyTests-1170033152 None] Created volume successfully. Sep 28 16:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Creating offline snapshot 744da8e0-0ad3-456f-be6e-c0934d3d9b1b of volume cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:22:54 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae84a45-16af-41c9-9913-b31f5c4e7577]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:54 devstack sudo[103297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:22:54 devstack sudo[103297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:55 devstack sudo[103297]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:55 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b 1G Sep 28 16:22:55 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:55 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b 1G" returned: 0 in 0.762s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd88e20-e62c-4c86-b478-c2e77252a2be -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:55 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd88e20-e62c-4c86-b478-c2e77252a2be -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:22:55 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:56 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfd88e20-e62c-4c86-b478-c2e77252a2be -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:56 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b is being set with open permissions: ugo+rw Sep 28 16:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:56 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:22:56 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:56 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.328s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:56 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info Sep 28 16:22:56 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:57 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info is being set with open permissions: ugo+rw Sep 28 16:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:57 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info Sep 28 16:22:57 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:57 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.info" returned: 0 in 0.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.895s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9ceff3ad-c23c-454b-81bc-52e65316057d tempest-SnapshotDependencyTests-1170033152 None] Create snapshot completed successfully Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Flow 'volume_create_manager' (8c297b84-c1c7-4716-a8d4-6386c964c9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49301c9f-3bb0-46a8-a873-426b2712e1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49301c9f-3bb0-46a8-a873-426b2712e1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=073b2c63-7b61-45f6-a31d-2e49d1a44884,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f9950912653403580edb6f156ef997c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=744da8e0-0ad3-456f-be6e-c0934d3d9b1b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:22:59Z,use_quota=True,user_id='485ee86f4611414986d1a93c0e004de6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427cb52-b515-47ad-bf24-0c03620b66d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c427cb52-b515-47ad-bf24-0c03620b66d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58693e40-c247-48dd-9124-6312681ccd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58693e40-c247-48dd-9124-6312681ccd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '073b2c63-7b61-45f6-a31d-2e49d1a44884', 'volume_name': 'volume-073b2c63-7b61-45f6-a31d-2e49d1a44884', 'volume_size': 1, 'snapshot_id': '744da8e0-0ad3-456f-be6e-c0934d3d9b1b'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4912069-ae96-4893-8bff-aa0254009311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4912069-ae96-4893-8bff-aa0254009311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1551a01c-ff12-4e93-b03b-cd2d36fc8cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:22:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Volume 073b2c63-7b61-45f6-a31d-2e49d1a44884: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-073b2c63-7b61-45f6-a31d-2e49d1a44884', 'volume_size': 1, 'snapshot_id': '744da8e0-0ad3-456f-be6e-c0934d3d9b1b'} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-073b2c63-7b61-45f6-a31d-2e49d1a44884" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-073b2c63-7b61-45f6-a31d-2e49d1a44884" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Creating volume 073b2c63-7b61-45f6-a31d-2e49d1a44884 from snapshot 744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] snapshot: 744da8e0-0ad3-456f-be6e-c0934d3d9b1b, volume: 073b2c63-7b61-45f6-a31d-2e49d1a44884, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:22:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[776ec7d4-39cd-4af2-842e-4b63e98c6832]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:22:59 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:22:59 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.573s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfd88e20-e62c-4c86-b478-c2e77252a2be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a10cb1-7a29-45bb-a47a-e0242f9b37ea]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:22:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:22:59 devstack sudo[103333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:22:59 devstack sudo[103333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:00 devstack sudo[103333]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.679s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:23:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:23:00 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:23:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:00 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 Sep 28 16:23:00 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:08 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=5,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:10 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884" returned: 0 in 10.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:10 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be, size 1024.00 MB, duration 10.37 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:23:10 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Converted 1024.00 MB image at 98.74 MB/s Sep 28 16:23:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 is being set with open permissions: ugo+rw Sep 28 16:23:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:10 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 Sep 28 16:23:10 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:11 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" released by "_copy_volume_from_snapshot" :: held 12.168s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-073b2c63-7b61-45f6-a31d-2e49d1a44884" released by "_create_volume_from_snapshot" :: held 12.275s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.298s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1551a01c-ff12-4e93-b03b-cd2d36fc8cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-073b2c63-7b61-45f6-a31d-2e49d1a44884', 'volume_size': 1, 'snapshot_id': '744da8e0-0ad3-456f-be6e-c0934d3d9b1b'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a6973b-241b-4c2d-8561-592900e3df16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Volume volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 (073b2c63-7b61-45f6-a31d-2e49d1a44884): created successfully Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a6973b-241b-4c2d-8561-592900e3df16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Flow 'volume_create_manager' (8c297b84-c1c7-4716-a8d4-6386c964c9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a42d1bab-4c8b-4a2b-b453-59a9c65c9549 tempest-SnapshotDependencyTests-1170033152 None] Created volume successfully. Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Deleting offline snapshot 744da8e0-0ad3-456f-be6e-c0934d3d9b1b of volume cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] snapshot_file for this snap is: volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[507e1fa4-d0ae-4d2a-8951-0319a42c563c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:12 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:23:13 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Flow 'volume_create_manager' (57892ab0-f162-40b3-8123-b3c7df4edb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca89727-b78e-463e-a625-498ff2e72ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ca89727-b78e-463e-a625-498ff2e72ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-185571149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3ec0664db04b0a8fe9480602bd66f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:13Z,use_quota=True,user_id='916cb6b503154a95875da814ee02833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabd0ab9-d3e3-4e7f-8c57-bd1521685575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fabd0ab9-d3e3-4e7f-8c57-bd1521685575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39d7d7f-4310-4772-b91e-5a33382c756b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39d7d7f-4310-4772-b91e-5a33382c756b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df', 'volume_name': 'volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171cef82-7170-43f9-a8c3-0f45c58767c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (171cef82-7170-43f9-a8c3-0f45c58767c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b643453-c43e-4d05-89ae-7c2ca8130b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Volume f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df', 'volume_size': 1} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-185571149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc3ec0664db04b0a8fe9480602bd66f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:23:13Z,use_quota=True,user_id='916cb6b503154a95875da814ee02833d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Creating volume f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:23:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:13 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:13 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df 1073741824 Sep 28 16:23:13 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.773s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfd88e20-e62c-4c86-b478-c2e77252a2be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[66376936-b6c1-45a9-b3c8-fc2f28ec1e01]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:13 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:23:13 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:14 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df 1073741824" returned: 0 in 0.666s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:14 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:23:14 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:14 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.764s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:14 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:23:14 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:14 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b643453-c43e-4d05-89ae-7c2ca8130b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a762399-02da-4b6e-8ed6-01c6fc1da5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:23:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Volume volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df (f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df): created successfully Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a762399-02da-4b6e-8ed6-01c6fc1da5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Flow 'volume_create_manager' (57892ab0-f162-40b3-8123-b3c7df4edb4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:23:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fa421086-4330-4f93-86cb-0b8783f9de67 tempest-TestImageHashVerification-1570091840 None] Created volume successfully. Sep 28 16:23:14 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.507s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:14 devstack sudo[103429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b Sep 28 16:23:14 devstack sudo[103429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:15 devstack sudo[103429]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be.744da8e0-0ad3-456f-be6e-c0934d3d9b1b" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-744da8e0-0ad3-456f-be6e-c0934d3d9b1b" released by "_delete_snapshot" :: held 2.579s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" released by "delete_snapshot" :: held 2.638s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Created reservations ['6202ab1c-59d0-4ef5-bbee-7c7317ae284c', 'c3fbbf02-24a1-429e-9368-6dab46fbc8d9', '96bc76c3-763d-4c41-9e00-f9935d46d98c', '254c7393-4d9c-45f6-ad2f-9ff01c976397'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Delete snapshot completed successfully. Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8a654dd9-50b7-4877-95fc-5f9ff4a05dde tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-744da8e0-0ad3-456f-be6e-c0934d3d9b1b-delete_snapshot" released by "delete_snapshot" :: held 2.985s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-cfd88e20-e62c-4c86-b478-c2e77252a2be-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-cfd88e20-e62c-4c86-b478-c2e77252a2be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a959fca-6068-4f70-a81d-f4475fde4f13]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:16 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:23:16 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:16 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.539s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:16 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be Sep 28 16:23:16 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:17 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-cfd88e20-e62c-4c86-b478-c2e77252a2be" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2df53cb-7b73-4a6d-981a-4244756692e3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-cfd88e20-e62c-4c86-b478-c2e77252a2be" released by "delete_volume" :: held 1.089s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Created reservations ['4d5d2d90-015b-44f3-9cf1-a9ddcf965df1', 'c65ec61c-fc20-46bf-9649-6974700430bf', 'dd562941-bdcd-4fe7-b550-35add4e2049d', '9d44ff68-b189-4389-8b33-4da3503eaf96'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:17 devstack sudo[103441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:23:17 devstack sudo[103441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack sudo[103443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:23:17 devstack sudo[103443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:17 devstack sudo[103443]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack sudo[103441]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.575s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Deleted volume successfully. Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afcd849-5ae4-4e27-82e1-595b674d4839]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-32ed9b95-856e-44cd-97c7-ad97ae111bb2 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-cfd88e20-e62c-4c86-b478-c2e77252a2be-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:17 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:23:17 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-073b2c63-7b61-45f6-a31d-2e49d1a44884-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-073b2c63-7b61-45f6-a31d-2e49d1a44884-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:18 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df /opt/stack/data/cinder/conversion/f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df.temp_image.c890a725-f388-42b4-ab3a-c3025086fe108ex08vem.img {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:18 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df /opt/stack/data/cinder/conversion/f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df.temp_image.c890a725-f388-42b4-ab3a-c3025086fe108ex08vem.img Sep 28 16:23:18 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e5047a-cc48-4918-bb53-0435d8c57019]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:18 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 Sep 28 16:23:18 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:19 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884" returned: 0 in 0.695s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:19 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884 Sep 28 16:23:19 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:19 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-073b2c63-7b61-45f6-a31d-2e49d1a44884" returned: 0 in 0.566s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-quobyte-073b2c63-7b61-45f6-a31d-2e49d1a44884" released by "delete_volume" :: held 1.367s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Created reservations ['87ed20d3-a802-49f9-98fe-498d6f8ec99e', '56bf8869-b4aa-456b-a169-078adc0731f0', 'bb690c7a-cef5-41ee-892e-740ea66139ac', 'd8076360-ef92-4d11-8c0b-eb8b48032877'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:20 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:23:20 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:20 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.730s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Deleted volume successfully. Sep 28 16:23:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-aebc42a0-70cf-47fa-9731-aafd33edf3f5 tempest-SnapshotDependencyTests-1170033152 None] Lock "cinder-073b2c63-7b61-45f6-a31d-2e49d1a44884-delete_volume" released by "delete_volume" :: held 2.699s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:23:28 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df /opt/stack/data/cinder/conversion/f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df.temp_image.c890a725-f388-42b4-ab3a-c3025086fe108ex08vem.img" returned: 0 in 10.178s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bbe992-e6bc-424f-b0a4-53149dcbccce]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:28 devstack sudo[103480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:23:28 devstack sudo[103480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:29 devstack sudo[103480]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.742s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:29 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df, size 1024.00 MB, duration 10.18 sec, destination /opt/stack/data/cinder/conversion/f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df.temp_image.c890a725-f388-42b4-ab3a-c3025086fe108ex08vem.img {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:23:29 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Converted 1024.00 MB image at 100.60 MB/s Sep 28 16:23:29 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] c890a725-f388-42b4-ab3a-c3025086fe10 was raw, no need to convert to raw {{(pid=87150) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 28 16:23:31 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=18,cinder:UPDATE=29,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:36 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:23:36 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:23:36 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.430s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:23:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:23:39 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=25 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:23:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.858s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:23:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Uploaded volume to glance image-id: c890a725-f388-42b4-ab3a-c3025086fe10. {{(pid=87150) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 28 16:23:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fb0c5e1c-c1d7-4bfa-9477-e5941f6109ae tempest-TestImageHashVerification-1570091840 None] Copy volume to image completed successfully. Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Acquiring lock "cinder-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "cinder-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Acquiring lock "cinder-quobyte-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "cinder-quobyte-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" acquired by "delete_volume" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910dd50-85b5-46b7-a15e-f75d0538dfa4]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:23:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:23:59 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:23:59 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:00 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.560s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:00 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df Sep 28 16:24:00 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:00 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" returned: 0 in 0.347s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "cinder-quobyte-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df" released by "delete_volume" :: held 0.978s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Created reservations ['0db40999-c7f9-472d-b8e9-82cb7faaaba1', '50c2c7f6-4911-487f-b76b-03b8c0cbc742', 'fd351529-a176-426f-ae19-3d2a4aaaf9c2', '39693542-738d-4ef0-9338-747ab45a8a64'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:00 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:00 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:01 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Deleted volume successfully. Sep 28 16:24:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b8e2c46-9164-4f85-9b85-2ad78de801da tempest-TestImageHashVerification-1570091840 None] Lock "cinder-f09e3f1e-6c28-4ad6-ac2e-cf033b43e9df-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:10 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:24:11 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (09bee40f-aa12-43a9-b212-ffebd34419fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cabdda-e8ff-48be-a2f9-8e68f8e94460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cabdda-e8ff-48be-a2f9-8e68f8e94460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712317447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe8475b-ebe4-4449-9831-f045729e5760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:20Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71c16a9-c9de-4ac4-ac7c-1183e2256a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c71c16a9-c9de-4ac4-ac7c-1183e2256a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22feef9-ce29-4d03-90ef-2b3eda644231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22feef9-ce29-4d03-90ef-2b3eda644231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fe8475b-ebe4-4449-9831-f045729e5760', 'volume_name': 'volume-0fe8475b-ebe4-4449-9831-f045729e5760', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6438f297-fbbd-470e-9459-7709c405856b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6438f297-fbbd-470e-9459-7709c405856b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31bb915-db87-48d8-a92b-7e4e1ca56098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume 0fe8475b-ebe4-4449-9831-f045729e5760: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fe8475b-ebe4-4449-9831-f045729e5760', 'volume_size': 1} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1712317447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fe8475b-ebe4-4449-9831-f045729e5760,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:20Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume 0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:20 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:20 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 1073741824 Sep 28 16:24:20 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:20 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 1073741824" returned: 0 in 0.533s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:20 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 Sep 28 16:24:20 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:21 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760" returned: 0 in 0.310s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31bb915-db87-48d8-a92b-7e4e1ca56098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fe8475b-ebe4-4449-9831-f045729e5760', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff2d43d-fb86-479b-9801-16d3f4232e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-0fe8475b-ebe4-4449-9831-f045729e5760 (0fe8475b-ebe4-4449-9831-f045729e5760): created successfully Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff2d43d-fb86-479b-9801-16d3f4232e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (09bee40f-aa12-43a9-b212-ffebd34419fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a3bce858-edbc-49e5-ba8f-891ad256a206 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating offline snapshot 01ab0874-1923-4ca1-a9e7-ac26b5124f07 of volume 0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9311d6b-3c49-4420-ad87-31cd0a7e7d5b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:22 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 Sep 28 16:24:22 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:22 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 1G Sep 28 16:24:23 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:23 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 1G" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe8475b-ebe4-4449-9831-f045729e5760 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe8475b-ebe4-4449-9831-f045729e5760 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 Sep 28 16:24:23 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:23 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fe8475b-ebe4-4449-9831-f045729e5760 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:23 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 is being set with open permissions: ugo+rw Sep 28 16:24:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:23 devstack sudo[103721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 Sep 28 16:24:23 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:24 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:24 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info Sep 28 16:24:24 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:24 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info" returned: 0 in 0.332s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info is being set with open permissions: ugo+rw Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:24 devstack sudo[103727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info Sep 28 16:24:24 devstack sudo[103727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:24 devstack sudo[103727]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.info" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-70f170bb-b901-440a-b115-c61bfc1c1720 tempest-CreateVolumesFromSnapshotTest-476530738 None] Create snapshot completed successfully Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (fc9ff5c9-9c19-4228-933b-811812a18903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070b1648-e89e-4951-8d73-2de443395f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070b1648-e89e-4951-8d73-2de443395f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983671038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7bf90-40bc-483a-bd33-e84e09273823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:26Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e489921f-f092-4e1d-97f8-5b78d61ca9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e489921f-f092-4e1d-97f8-5b78d61ca9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d3b4dd-e3b6-42d2-ab7d-4faac0c7e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d3b4dd-e3b6-42d2-ab7d-4faac0c7e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb7bf90-40bc-483a-bd33-e84e09273823', 'volume_name': 'volume-dcb7bf90-40bc-483a-bd33-e84e09273823', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067f1009-5811-451d-a489-23d2aa81327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067f1009-5811-451d-a489-23d2aa81327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b4f5f-1d0b-4513-8239-1bbfb07b6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume dcb7bf90-40bc-483a-bd33-e84e09273823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb7bf90-40bc-483a-bd33-e84e09273823', 'volume_size': 1} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-983671038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7bf90-40bc-483a-bd33-e84e09273823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:26Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume dcb7bf90-40bc-483a-bd33-e84e09273823 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:26 devstack sudo[103730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 1073741824 Sep 28 16:24:26 devstack sudo[103730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (e329c5b6-419d-47b4-af42-b1ec465aefb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d67964-4345-44a8-a37e-13ad94811aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d67964-4345-44a8-a37e-13ad94811aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867426304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505801fe-889c-4077-8db8-bfcf380a5d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:27Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793f9d8-11f7-4d3d-af2b-bda6a20e2632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e793f9d8-11f7-4d3d-af2b-bda6a20e2632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb78f1-c699-40eb-955b-0182754ae424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eebb78f1-c699-40eb-955b-0182754ae424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505801fe-889c-4077-8db8-bfcf380a5d90', 'volume_name': 'volume-505801fe-889c-4077-8db8-bfcf380a5d90', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0a6ba6-95c9-4e73-8c0e-b228340eb495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0a6ba6-95c9-4e73-8c0e-b228340eb495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3962bf6-298b-4fca-b7b2-3a12c8f1d37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume 505801fe-889c-4077-8db8-bfcf380a5d90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505801fe-889c-4077-8db8-bfcf380a5d90', 'volume_size': 1} Sep 28 16:24:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:27 devstack sudo[103730]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 1073741824" returned: 0 in 0.869s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:27 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 Sep 28 16:24:27 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (38aaed74-ef3a-49ea-a07f-39d3b6456983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a425c25f-4e90-4744-a144-ceaca32b13c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a425c25f-4e90-4744-a144-ceaca32b13c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880470368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed88c165-e17d-4539-ae45-3491ca1898e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:27Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6829c7a-36cf-4b0c-aa9a-f473029faf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6829c7a-36cf-4b0c-aa9a-f473029faf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce608cc9-cd80-49ef-bd00-5c71c6655767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce608cc9-cd80-49ef-bd00-5c71c6655767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed88c165-e17d-4539-ae45-3491ca1898e3', 'volume_name': 'volume-ed88c165-e17d-4539-ae45-3491ca1898e3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f972f2-9849-4d88-be44-16e87fa84abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11f972f2-9849-4d88-be44-16e87fa84abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a790c9-aba7-4d4a-ab13-d0b03080d14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume ed88c165-e17d-4539-ae45-3491ca1898e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed88c165-e17d-4539-ae45-3491ca1898e3', 'volume_size': 1} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:27 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (1342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.344s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.779s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-867426304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505801fe-889c-4077-8db8-bfcf380a5d90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:27Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume 505801fe-889c-4077-8db8-bfcf380a5d90 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:27 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:27 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 1073741824 Sep 28 16:24:27 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (105b4f5f-1d0b-4513-8239-1bbfb07b6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb7bf90-40bc-483a-bd33-e84e09273823', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494378c8-c87f-4c7d-bcb4-faa9e4824428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-dcb7bf90-40bc-483a-bd33-e84e09273823 (dcb7bf90-40bc-483a-bd33-e84e09273823): created successfully Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494378c8-c87f-4c7d-bcb4-faa9e4824428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (fc9ff5c9-9c19-4228-933b-811812a18903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-347a48a5-36c0-4076-8b4b-4612b30c023c tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (daff4da1-d2c2-4dfc-aa98-71a63c8a0642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f707c8-02fa-4ff3-bbeb-f303bed3dff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f707c8-02fa-4ff3-bbeb-f303bed3dff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2099335397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e50724-0f2d-4789-b971-88a099344813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:28Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d050fb9-3f86-49eb-897b-4748e3311926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d050fb9-3f86-49eb-897b-4748e3311926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542dc047-44c6-4820-aaae-99a8b976090a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (542dc047-44c6-4820-aaae-99a8b976090a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e50724-0f2d-4789-b971-88a099344813', 'volume_name': 'volume-d0e50724-0f2d-4789-b971-88a099344813', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0572c1-e9b7-4f7d-ae02-85af7a42ac9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0572c1-e9b7-4f7d-ae02-85af7a42ac9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7770e9e4-d3b3-40ed-896d-272e10b158d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume d0e50724-0f2d-4789-b971-88a099344813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e50724-0f2d-4789-b971-88a099344813', 'volume_size': 1} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:28 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 1073741824" returned: 0 in 0.670s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:28 devstack sudo[103746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 Sep 28 16:24:28 devstack sudo[103746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (428d5ad7-52cd-4073-921e-338e1fde724d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e3395-3f4b-422d-bec6-d95b0be53656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44e3395-3f4b-422d-bec6-d95b0be53656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656665164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fa3ec3-cb9a-434d-ac22-590a497a3767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:29Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea4b3f3-4442-4c19-8377-42ac81086628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea4b3f3-4442-4c19-8377-42ac81086628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1490ed75-f3c3-4c5d-a166-ce4c25b31ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1490ed75-f3c3-4c5d-a166-ce4c25b31ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fa3ec3-cb9a-434d-ac22-590a497a3767', 'volume_name': 'volume-57fa3ec3-cb9a-434d-ac22-590a497a3767', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe437f58-e1b1-4f89-b5a4-ad643309a417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe437f58-e1b1-4f89-b5a4-ad643309a417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bb4693-b561-4973-8aeb-f6aca95a94a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume 57fa3ec3-cb9a-434d-ac22-590a497a3767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fa3ec3-cb9a-434d-ac22-590a497a3767', 'volume_size': 1} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:28 devstack sudo[103746]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90" returned: 0 in 0.339s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.092s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1880470368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed88c165-e17d-4539-ae45-3491ca1898e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:27Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume ed88c165-e17d-4539-ae45-3491ca1898e3 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:28 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 1073741824 Sep 28 16:24:28 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3962bf6-298b-4fca-b7b2-3a12c8f1d37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505801fe-889c-4077-8db8-bfcf380a5d90', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be52ad5-843b-4627-87f3-aa4f3b7d0901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-505801fe-889c-4077-8db8-bfcf380a5d90 (505801fe-889c-4077-8db8-bfcf380a5d90): created successfully Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be52ad5-843b-4627-87f3-aa4f3b7d0901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (e329c5b6-419d-47b4-af42-b1ec465aefb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-90c8f556-274f-4d91-8577-186d6e97005c tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:29 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 1073741824" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:29 devstack sudo[103755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 Sep 28 16:24:29 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:29 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3" returned: 0 in 0.341s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.581s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2099335397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e50724-0f2d-4789-b971-88a099344813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:28Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume d0e50724-0f2d-4789-b971-88a099344813 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:29 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 1073741824 Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7a790c9-aba7-4d4a-ab13-d0b03080d14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed88c165-e17d-4539-ae45-3491ca1898e3', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fa0e79-a573-4c13-a9b5-96e9de4a3f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-ed88c165-e17d-4539-ae45-3491ca1898e3 (ed88c165-e17d-4539-ae45-3491ca1898e3): created successfully Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10fa0e79-a573-4c13-a9b5-96e9de4a3f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (38aaed74-ef3a-49ea-a07f-39d3b6456983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c4486b3e-ff69-48f5-97fe-0f8448b6dbce tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:30 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 1073741824" returned: 0 in 0.610s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:30 devstack sudo[103765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 Sep 28 16:24:30 devstack sudo[103765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:30 devstack sudo[103765]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.986s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-656665164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fa3ec3-cb9a-434d-ac22-590a497a3767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21650eb1ecd4442286c6fef82bb294a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:29Z,use_quota=True,user_id='13909d9d0ece47d9b6c673c3157f0c27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Creating volume 57fa3ec3-cb9a-434d-ac22-590a497a3767 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:30 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 1073741824 Sep 28 16:24:30 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7770e9e4-d3b3-40ed-896d-272e10b158d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e50724-0f2d-4789-b971-88a099344813', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c024d7-b862-46b5-bb6e-57b5f707302c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-d0e50724-0f2d-4789-b971-88a099344813 (d0e50724-0f2d-4789-b971-88a099344813): created successfully Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c024d7-b862-46b5-bb6e-57b5f707302c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (daff4da1-d2c2-4dfc-aa98-71a63c8a0642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ac35e567-3697-4580-b6cd-09ce1dcc935f tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Flow 'volume_create_manager' (6457ea81-a1a0-43e5-b17a-976eb09cf063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd47b320-5521-4ac1-a6be-0dcb711283a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd47b320-5521-4ac1-a6be-0dcb711283a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-979939952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816f0a09-803d-4ef4-acf2-f68fcdc58ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f1f426c90141d1b29534b13bcfd279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:31Z,use_quota=True,user_id='3b367ce585a44b198db8a15fbbd33db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bced52b-fb56-4b68-81ce-9c9cbe13b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bced52b-fb56-4b68-81ce-9c9cbe13b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a0d7b9-3366-4f50-ac74-e7df95b2e767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a0d7b9-3366-4f50-ac74-e7df95b2e767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '816f0a09-803d-4ef4-acf2-f68fcdc58ffa', 'volume_name': 'volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de478f6-d73f-41b1-9246-4b76237c2698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9de478f6-d73f-41b1-9246-4b76237c2698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e65888-de8a-4189-8aca-11ff51c511c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Volume 816f0a09-803d-4ef4-acf2-f68fcdc58ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa', 'volume_size': 1} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:31 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 1073741824" returned: 0 in 0.578s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:31 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 Sep 28 16:24:31 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:31 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.504s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-979939952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816f0a09-803d-4ef4-acf2-f68fcdc58ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f1f426c90141d1b29534b13bcfd279',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:31Z,use_quota=True,user_id='3b367ce585a44b198db8a15fbbd33db5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Creating volume 816f0a09-803d-4ef4-acf2-f68fcdc58ffa {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bb4693-b561-4973-8aeb-f6aca95a94a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fa3ec3-cb9a-434d-ac22-590a497a3767', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dc9b38-a95a-4964-b1c9-2929f9a63ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:31 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa 1073741824 Sep 28 16:24:31 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Volume volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 (57fa3ec3-cb9a-434d-ac22-590a497a3767): created successfully Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8dc9b38-a95a-4964-b1c9-2929f9a63ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Flow 'volume_create_manager' (428d5ad7-52cd-4073-921e-338e1fde724d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e7a2bd96-f114-4dfc-a71c-f9a41cd50c27 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created volume successfully. Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-57fa3ec3-cb9a-434d-ac22-590a497a3767-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-57fa3ec3-cb9a-434d-ac22-590a497a3767-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-57fa3ec3-cb9a-434d-ac22-590a497a3767" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-57fa3ec3-cb9a-434d-ac22-590a497a3767" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:32 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa 1073741824" returned: 0 in 0.608s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47b5785-f124-49e5-ad62-07537addf4a9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:32 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa Sep 28 16:24:32 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:32 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 Sep 28 16:24:32 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:32 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e65888-de8a-4189-8aca-11ff51c511c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673a3517-c843-4f50-b6ea-963974a0a692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Volume volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa (816f0a09-803d-4ef4-acf2-f68fcdc58ffa): created successfully Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673a3517-c843-4f50-b6ea-963974a0a692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Flow 'volume_create_manager' (6457ea81-a1a0-43e5-b17a-976eb09cf063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1ef48329-e27f-4a09-bc7b-4d6f212976cf tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Created volume successfully. Sep 28 16:24:32 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:32 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767 Sep 28 16:24:32 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:33 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-57fa3ec3-cb9a-434d-ac22-590a497a3767" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-57fa3ec3-cb9a-434d-ac22-590a497a3767" released by "delete_volume" :: held 0.847s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['0ea9b4b7-267b-4ac3-bb59-db28dd1a6625', '64d45e2c-131c-4ddc-bd1f-d6234fdd4859', '95103d1b-1b2c-4c03-9df3-1a306e78ec20', 'edd5f6e3-333d-49f5-a64b-8292e75ca242'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:33 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:33 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-d0e50724-0f2d-4789-b971-88a099344813-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-d0e50724-0f2d-4789-b971-88a099344813-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-d0e50724-0f2d-4789-b971-88a099344813" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-d0e50724-0f2d-4789-b971-88a099344813" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381b427-43d0-4fc8-af7f-643a6cb840c7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:33 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-87a5aaad-bd4a-4f88-8f61-099632255e7a tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-57fa3ec3-cb9a-434d-ac22-590a497a3767-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:33 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 Sep 28 16:24:33 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:34 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813" returned: 0 in 0.527s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:34 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813 Sep 28 16:24:34 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d94840e4-1e61-4dab-8769-543041b3805c req-77db0040-acb1-4be4-889e-01d50a6cc2ac tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d94840e4-1e61-4dab-8769-543041b3805c req-77db0040-acb1-4be4-889e-01d50a6cc2ac tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-d94840e4-1e61-4dab-8769-543041b3805c req-77db0040-acb1-4be4-889e-01d50a6cc2ac tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-d94840e4-1e61-4dab-8769-543041b3805c req-77db0040-acb1-4be4-889e-01d50a6cc2ac tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8cf38f7-bd4a-4d09-8986-73aa60838187', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:24:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-d94840e4-1e61-4dab-8769-543041b3805c req-77db0040-acb1-4be4-889e-01d50a6cc2ac tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] attachment_update completed successfully. Sep 28 16:24:34 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d0e50724-0f2d-4789-b971-88a099344813" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-d0e50724-0f2d-4789-b971-88a099344813" released by "delete_volume" :: held 0.975s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['d82da591-aa91-4c09-a08d-303f2f2a6fda', 'cb8f1e82-cf54-4186-9778-5257cd38d248', '6b70ba65-3769-41da-9331-07d2ae0e5f5f', '0d7d8d1b-7b56-4608-b071-9069c2ca4be5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:34 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:34 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:35 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6405fc3b-d0c1-474f-ac73-c61c540a99b3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-d0e50724-0f2d-4789-b971-88a099344813-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-ed88c165-e17d-4539-ae45-3491ca1898e3-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-ed88c165-e17d-4539-ae45-3491ca1898e3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-ed88c165-e17d-4539-ae45-3491ca1898e3" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-ed88c165-e17d-4539-ae45-3491ca1898e3" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6d1f8d-20f8-4d7e-896e-c035bf96b1c3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:36 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 Sep 28 16:24:36 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3" returned: 0 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:36 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3 Sep 28 16:24:36 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:36 devstack sudo[104243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:36 devstack sudo[104243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ed88c165-e17d-4539-ae45-3491ca1898e3" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-ed88c165-e17d-4539-ae45-3491ca1898e3" released by "delete_volume" :: held 0.794s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['5d8c698e-1982-417c-a098-9f25f63f9209', '02728502-57f1-4810-a9e2-8e0f523a18aa', 'fbc24a80-9328-418e-8923-dca7d803b8ba', '7303f665-16f3-4fae-a567-de3173fdebdb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:36 devstack sudo[104243]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:36 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:24:36 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-505801fe-889c-4077-8db8-bfcf380a5d90-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-505801fe-889c-4077-8db8-bfcf380a5d90-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-505801fe-889c-4077-8db8-bfcf380a5d90" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-505801fe-889c-4077-8db8-bfcf380a5d90" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dd5abb-dbd1-4661-b84e-70b5313026af]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:37 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-91cfa02d-5f33-4937-9188-357c79aedf47 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-ed88c165-e17d-4539-ae45-3491ca1898e3-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:37 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 Sep 28 16:24:37 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:37 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90" returned: 0 in 0.443s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:37 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90 Sep 28 16:24:37 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:37 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-505801fe-889c-4077-8db8-bfcf380a5d90" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-505801fe-889c-4077-8db8-bfcf380a5d90" released by "delete_volume" :: held 0.849s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['fe28e7ca-b4e0-496e-916d-32744c71a48c', '4057cc4e-58b0-4909-8009-b99dad4c5924', '1518840b-34a5-4bb4-b1d1-034bc2df3f78', '79e13a96-2f5d-42b9-ad84-43932ea08cd9'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:38 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:38 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-dcb7bf90-40bc-483a-bd33-e84e09273823-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-dcb7bf90-40bc-483a-bd33-e84e09273823-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-dcb7bf90-40bc-483a-bd33-e84e09273823" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-dcb7bf90-40bc-483a-bd33-e84e09273823" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[71554caf-c282-49a1-8b31-3e4837f845d8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-2a45cb55-bcab-4bb7-ab15-31728538c3c1 req-cfb8a272-fc0e-45a2-94da-f1b7fd4940c9 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Terminate volume connection completed successfully. Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-2a45cb55-bcab-4bb7-ab15-31728538c3c1 req-cfb8a272-fc0e-45a2-94da-f1b7fd4940c9 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Deleting attachment b8cf38f7-bd4a-4d09-8986-73aa60838187. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:24:38 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5e9a2a9c-daa3-40cc-86c6-4a5ee93c36e3 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-505801fe-889c-4077-8db8-bfcf380a5d90-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:38 devstack sudo[104292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 Sep 28 16:24:38 devstack sudo[104292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:38 devstack sudo[104292]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:38 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823 Sep 28 16:24:38 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "cinder-816f0a09-803d-4ef4-acf2-f68fcdc58ffa-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "cinder-816f0a09-803d-4ef4-acf2-f68fcdc58ffa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "cinder-quobyte-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "cinder-quobyte-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:39 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-dcb7bf90-40bc-483a-bd33-e84e09273823" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-dcb7bf90-40bc-483a-bd33-e84e09273823" released by "delete_volume" :: held 0.851s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[21acae9e-479d-49e8-9ac1-cd28fdc4f2cd]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['b4969db7-f03b-4278-b6b2-a7ea4e330e72', '46723992-46b7-4837-9bcd-5ddb93980181', '934190c0-f44a-4284-9afb-4ad5d293c88f', 'd993d67c-c244-4873-bc39-fd28214acd9f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:39 devstack sudo[104301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa Sep 28 16:24:39 devstack sudo[104301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:39 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:39 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-01ab0874-1923-4ca1-a9e7-ac26b5124f07-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-01ab0874-1923-4ca1-a9e7-ac26b5124f07-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-01ab0874-1923-4ca1-a9e7-ac26b5124f07" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-01ab0874-1923-4ca1-a9e7-ac26b5124f07" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleting offline snapshot 01ab0874-1923-4ca1-a9e7-ac26b5124f07 of volume 0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] snapshot_file for this snap is: volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0ed393-8b7b-417b-b0ed-b742206d8429]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:39 devstack sudo[104301]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" returned: 0 in 0.468s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:39 devstack sudo[104311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa Sep 28 16:24:39 devstack sudo[104311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:39 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:39 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 Sep 28 16:24:39 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d59f2e6f-9f00-4bb1-9006-31a6c6817709 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-dcb7bf90-40bc-483a-bd33-e84e09273823-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:39 devstack sudo[104311]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "cinder-quobyte-816f0a09-803d-4ef4-acf2-f68fcdc58ffa" released by "delete_volume" :: held 0.818s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Created reservations ['3b2897d2-d9a4-42ab-9487-57068f5490dd', 'a622ed39-a7e7-4919-ade5-176a79260dfe', '47601ee6-3fc5-4a8f-ae15-fc02fa7caa40', '74e16a47-84e1-4b92-82c4-2c17acf647bf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:40 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07" returned: 0 in 0.480s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fe8475b-ebe4-4449-9831-f045729e5760(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d27f54-24ad-49a3-a4aa-ac5900b46ed1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:40 devstack sudo[104319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:40 devstack sudo[104319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:40 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 Sep 28 16:24:40 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:40 devstack sudo[104319]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.338s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Deleted volume successfully. Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-854e2962-24c6-4507-b9fa-d70ecdfc5551 tempest-TestServerVolumeAttachScenarioOldVersion-1270479213 None] Lock "cinder-816f0a09-803d-4ef4-acf2-f68fcdc58ffa-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:40 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760" returned: 0 in 0.500s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:40 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 Sep 28 16:24:40 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:41 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07" returned: 0 in 0.588s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:41 devstack sudo[104356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07 Sep 28 16:24:41 devstack sudo[104356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:41 devstack sudo[104356]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760.01ab0874-1923-4ca1-a9e7-ac26b5124f07" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-01ab0874-1923-4ca1-a9e7-ac26b5124f07" released by "_delete_snapshot" :: held 2.100s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" released by "delete_snapshot" :: held 2.143s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['0ad2b80f-3ada-4331-aed9-3ac2981f8658', '499a330d-842a-4389-87b7-0db1a39613c4', '381647a4-d26a-40b5-aaf4-4db35c017ae5', 'b41fd681-e2de-43d8-84ca-81bd71326f9e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Delete snapshot completed successfully. Sep 28 16:24:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cb107307-0bb2-4591-b4fe-131b342a7c19 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-01ab0874-1923-4ca1-a9e7-ac26b5124f07-delete_snapshot" released by "delete_snapshot" :: held 2.345s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-0fe8475b-ebe4-4449-9831-f045729e5760-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-0fe8475b-ebe4-4449-9831-f045729e5760-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" acquired by "delete_volume" :: waited 0.033s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0a623d-c110-48e5-a560-cc41ecb7f478]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:43 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 Sep 28 16:24:43 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:43 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760" returned: 0 in 0.534s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:43 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760 Sep 28 16:24:43 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:43 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0fe8475b-ebe4-4449-9831-f045729e5760" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-quobyte-0fe8475b-ebe4-4449-9831-f045729e5760" released by "delete_volume" :: held 0.925s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Created reservations ['b71cc118-0c22-495b-a848-267ecf0f52b4', '14f05230-a24e-44d7-afc8-85234e6b7ab0', '96652527-0d83-4837-8c79-10f0afed8731', '297f4ede-65f7-4480-84b4-925427a5b844'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:44 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:44 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:44 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Deleted volume successfully. Sep 28 16:24:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c815d2e3-4db8-4369-8259-8f3ade4fce22 tempest-CreateVolumesFromSnapshotTest-476530738 None] Lock "cinder-0fe8475b-ebe4-4449-9831-f045729e5760-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (7f9460da-9449-4092-9526-aa059d8d7932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229db842-0ee7-4f9d-a8a8-e60cbffe81fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229db842-0ee7-4f9d-a8a8-e60cbffe81fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1605994395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887639d5-accb-4c56-b1b6-198aa4acc259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:48Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da057fb7-266a-4ad8-9651-5f5d3fefbaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da057fb7-266a-4ad8-9651-5f5d3fefbaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f5dd1-e7e8-4355-be64-7c8a36f97cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95f5dd1-e7e8-4355-be64-7c8a36f97cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887639d5-accb-4c56-b1b6-198aa4acc259', 'volume_name': 'volume-887639d5-accb-4c56-b1b6-198aa4acc259', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67dc28c-3662-4009-a66b-78951a3dd8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67dc28c-3662-4009-a66b-78951a3dd8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ebbf0-6b3f-4582-89b7-58964a68fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume 887639d5-accb-4c56-b1b6-198aa4acc259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887639d5-accb-4c56-b1b6-198aa4acc259', 'volume_size': 1} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1605994395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887639d5-accb-4c56-b1b6-198aa4acc259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:48Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume 887639d5-accb-4c56-b1b6-198aa4acc259 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:47 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:47 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 1073741824 Sep 28 16:24:47 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:48 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 1073741824" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:48 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 Sep 28 16:24:48 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:48 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a9ebbf0-6b3f-4582-89b7-58964a68fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887639d5-accb-4c56-b1b6-198aa4acc259', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3f76e-b21e-4648-9220-3357e553d20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-887639d5-accb-4c56-b1b6-198aa4acc259 (887639d5-accb-4c56-b1b6-198aa4acc259): created successfully Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f3f76e-b21e-4648-9220-3357e553d20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (7f9460da-9449-4092-9526-aa059d8d7932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-068fe09f-2fe9-4720-a838-099d6589d25a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (33fb99e5-af9d-45cf-a779-5db1cdedfb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaa5a69-2c12-4633-a552-dcf844be9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbaa5a69-2c12-4633-a552-dcf844be9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784198032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc6696b-2e24-4ad4-8f0e-05f58f25329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:50Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b47109-26d6-4955-a6d9-f25dd08c52c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b47109-26d6-4955-a6d9-f25dd08c52c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427efb7e-85cb-477e-ace7-de9c11ea01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (427efb7e-85cb-477e-ace7-de9c11ea01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dc6696b-2e24-4ad4-8f0e-05f58f25329d', 'volume_name': 'volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d22b1-c35c-4467-a3c2-64b666f27423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0d22b1-c35c-4467-a3c2-64b666f27423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203287bf-5734-434a-97ab-e445c3cc5b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:50 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume 0dc6696b-2e24-4ad4-8f0e-05f58f25329d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d', 'volume_size': 1} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1784198032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dc6696b-2e24-4ad4-8f0e-05f58f25329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:50Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume 0dc6696b-2e24-4ad4-8f0e-05f58f25329d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:50 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:50 devstack sudo[104387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d 1073741824 Sep 28 16:24:50 devstack sudo[104387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (e9251622-b081-4c2a-9de0-9297ad5d58d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f37a233-e05e-4e70-985a-22d11b9ccba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f37a233-e05e-4e70-985a-22d11b9ccba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916232380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfb784b-06fc-4673-98d5-31d02a31fa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:51Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb3937c-8739-41e1-8f7a-8b3601c9fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb3937c-8739-41e1-8f7a-8b3601c9fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ac56e4-e151-43b4-8dfb-2a70c56d7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0ac56e4-e151-43b4-8dfb-2a70c56d7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbfb784b-06fc-4673-98d5-31d02a31fa23', 'volume_name': 'volume-fbfb784b-06fc-4673-98d5-31d02a31fa23', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174abb0b-bf00-4648-b76f-4af2507ca3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (174abb0b-bf00-4648-b76f-4af2507ca3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c782d77-5c70-4684-b5e6-bdac19014d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume fbfb784b-06fc-4673-98d5-31d02a31fa23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbfb784b-06fc-4673-98d5-31d02a31fa23', 'volume_size': 1} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:51 devstack sudo[104387]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d 1073741824" returned: 0 in 0.698s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:51 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d Sep 28 16:24:51 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (a7686202-edd4-46b0-9b77-8bef51d46721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6543880f-bda9-41f4-8b46-b38408497ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6543880f-bda9-41f4-8b46-b38408497ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950039250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74149dc6-ca3e-4e3f-b80b-b5b3c2d75665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:51Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3a3c9a-25f6-472b-b8f7-8600058d9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3a3c9a-25f6-472b-b8f7-8600058d9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727014a5-cff0-4bb8-a297-f9a7a54f6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727014a5-cff0-4bb8-a297-f9a7a54f6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74149dc6-ca3e-4e3f-b80b-b5b3c2d75665', 'volume_name': 'volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd437e-14d7-4e49-a910-1360bfd5120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bddd437e-14d7-4e49-a910-1360bfd5120a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0bd69a-ad0b-46ec-9479-70fa562317ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume 74149dc6-ca3e-4e3f-b80b-b5b3c2d75665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665', 'volume_size': 1} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:51 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.208s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916232380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbfb784b-06fc-4673-98d5-31d02a31fa23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:51Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume fbfb784b-06fc-4673-98d5-31d02a31fa23 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:51 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (203287bf-5734-434a-97ab-e445c3cc5b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:51 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 1073741824 Sep 28 16:24:51 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77e81fc-682d-4d37-83c3-083d9a06eb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d (0dc6696b-2e24-4ad4-8f0e-05f58f25329d): created successfully Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77e81fc-682d-4d37-83c3-083d9a06eb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (33fb99e5-af9d-45cf-a779-5db1cdedfb85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6b9b5999-9eba-4e5f-8d32-1b90b1023b07 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (54c05280-b86c-4a2d-aed2-440f17a1fd12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10575505-80c5-4986-8a59-087cbb008415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10575505-80c5-4986-8a59-087cbb008415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852791785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:52Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c811644-7ed9-4a68-808c-b85542e247ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c811644-7ed9-4a68-808c-b85542e247ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f320a1-4097-45e6-9e81-e057f6bd51a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f320a1-4097-45e6-9e81-e057f6bd51a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd', 'volume_name': 'volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f70c61-8a0d-41bb-8a8a-3adbc2d89f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f70c61-8a0d-41bb-8a8a-3adbc2d89f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2f0c6-7ce4-4767-8bf4-32460c0cde33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume 8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd', 'volume_size': 1} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:52 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 1073741824" returned: 0 in 0.697s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (e9bbb727-1e1e-4156-94c0-4db1ee2e921e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7115545d-2796-45e3-9274-94edf6502a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7115545d-2796-45e3-9274-94edf6502a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130288669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad17fc3-3a1d-4300-9904-5cd41c10090e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:53Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 Sep 28 16:24:52 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b92aed-6f18-424e-8c85-24cc854f600e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56b92aed-6f18-424e-8c85-24cc854f600e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4293130d-fd44-4d5c-b767-2858a07dadca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4293130d-fd44-4d5c-b767-2858a07dadca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ad17fc3-3a1d-4300-9904-5cd41c10090e', 'volume_name': 'volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6426b4-3d1e-444e-a4d4-7f90e9f6b3f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c6426b4-3d1e-444e-a4d4-7f90e9f6b3f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b09c2e-a6e8-43ee-bfae-652d3ccf15c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume 4ad17fc3-3a1d-4300-9904-5cd41c10090e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e', 'volume_size': 1} Sep 28 16:24:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:53 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1950039250',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74149dc6-ca3e-4e3f-b80b-b5b3c2d75665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:51Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume 74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c782d77-5c70-4684-b5e6-bdac19014d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbfb784b-06fc-4673-98d5-31d02a31fa23', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:53 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 1073741824 Sep 28 16:24:53 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65b56cc-ba09-4e75-a496-b94b26539350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 (fbfb784b-06fc-4673-98d5-31d02a31fa23): created successfully Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65b56cc-ba09-4e75-a496-b94b26539350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (e9251622-b081-4c2a-9de0-9297ad5d58d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ae36009a-83ed-403e-b8d6-bf07ddb8a938 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:53 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 1073741824" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:53 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 Sep 28 16:24:53 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:53 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" returned: 0 in 0.311s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.739s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1852791785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:52Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume 8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:53 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b0bd69a-ad0b-46ec-9479-70fa562317ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31a56b5-280c-4c06-9648-a7282556b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:54 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd 1073741824 Sep 28 16:24:54 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 (74149dc6-ca3e-4e3f-b80b-b5b3c2d75665): created successfully Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c31a56b5-280c-4c06-9648-a7282556b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (a7686202-edd4-46b0-9b77-8bef51d46721) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-acaf0ed7-cd9b-4ef7-81e3-04ff4162045a tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:54 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd 1073741824" returned: 0 in 0.521s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:54 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd Sep 28 16:24:54 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:54 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1130288669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ad17fc3-3a1d-4300-9904-5cd41c10090e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4c0a7e9665f493f96264774f8b3dfab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:24:53Z,use_quota=True,user_id='06739b866db64f899c985865e7141aeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Creating volume 4ad17fc3-3a1d-4300-9904-5cd41c10090e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:24:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eff2f0c6-7ce4-4767-8bf4-32460c0cde33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:54 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e 1073741824 Sep 28 16:24:54 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160ca701-32f3-4381-b058-2ec7bd0c5db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd (8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd): created successfully Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160ca701-32f3-4381-b058-2ec7bd0c5db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (54c05280-b86c-4a2d-aed2-440f17a1fd12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a6e332c9-280b-46c8-8d29-51ddffa4c532 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:55 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e 1073741824" returned: 0 in 0.579s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:55 devstack sudo[104428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e Sep 28 16:24:55 devstack sudo[104428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:55 devstack sudo[104428]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e" returned: 0 in 0.300s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b09c2e-a6e8-43ee-bfae-652d3ccf15c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e880e22-bf11-42dc-a932-8fb7ba118d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:24:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Volume volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e (4ad17fc3-3a1d-4300-9904-5cd41c10090e): created successfully Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e880e22-bf11-42dc-a932-8fb7ba118d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:24:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Flow 'volume_create_manager' (e9bbb727-1e1e-4156-94c0-4db1ee2e921e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:24:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-76ff2aae-7482-47fb-95d0-212618b3e93b tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created volume successfully. Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-4ad17fc3-3a1d-4300-9904-5cd41c10090e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-4ad17fc3-3a1d-4300-9904-5cd41c10090e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-4ad17fc3-3a1d-4300-9904-5cd41c10090e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-4ad17fc3-3a1d-4300-9904-5cd41c10090e" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3fb654-082f-4e97-ba00-619a8e5ac998]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:56 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e Sep 28 16:24:56 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:56 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e" returned: 0 in 0.470s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:56 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e Sep 28 16:24:56 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:57 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4ad17fc3-3a1d-4300-9904-5cd41c10090e" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-4ad17fc3-3a1d-4300-9904-5cd41c10090e" released by "delete_volume" :: held 0.867s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['ef05485f-5097-4746-8cda-492f6da8f78e', '6b94a349-13b9-4269-986b-8a0d49383695', '1bdc0646-d274-43f1-8ac0-802da2520653', 'd393546f-df1e-49a3-bad8-eafa1574242c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:57 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:57 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fded87cf-4c4c-41d5-81f4-4d64e650b4be]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:57 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:57 devstack sudo[104444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:57 devstack sudo[104444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:24:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc99570e-4281-4a05-8beb-57ed75656f01 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-4ad17fc3-3a1d-4300-9904-5cd41c10090e-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:57 devstack sudo[104444]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" returned: 0 in 0.502s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:58 devstack sudo[104450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd Sep 28 16:24:58 devstack sudo[104450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:58 devstack sudo[104450]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" returned: 0 in 0.301s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd" released by "delete_volume" :: held 0.860s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['d170bdba-74f3-4629-bf85-c7196989da8b', '9fb1360f-0305-465c-82fd-ae15695823e5', '4b18803d-ab50-4c63-b7b6-87a5e7ab1433', '8ed1eb3a-6d66-4480-9d13-dfda655ad18b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:58 devstack sudo[104453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:58 devstack sudo[104453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[261244e4-7437-4352-b8bd-fbc945c3bac3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:58 devstack sudo[104453]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:24:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:24:58 devstack sudo[104455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 Sep 28 16:24:58 devstack sudo[104455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f5eac4b-8067-46e3-93b7-23cb8b0fc3bc tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-8bf3db00-0144-4dbe-b4de-dcfa6a7c0cbd-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:59 devstack sudo[104455]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:59 devstack sudo[104461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665 Sep 28 16:24:59 devstack sudo[104461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:59 devstack sudo[104461]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665" released by "delete_volume" :: held 0.783s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['43e7381e-6de9-40db-9b5d-056bfeaaba4b', 'caf74e6b-6fa4-4e8c-b21a-6c88359b6563', '912b877c-9fe5-4233-a605-a43a6926121c', '34ae187b-c281-429c-ac36-917be64180c7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:24:59 devstack sudo[104464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:24:59 devstack sudo[104464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-fbfb784b-06fc-4673-98d5-31d02a31fa23-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-fbfb784b-06fc-4673-98d5-31d02a31fa23-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-fbfb784b-06fc-4673-98d5-31d02a31fa23" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-fbfb784b-06fc-4673-98d5-31d02a31fa23" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5a0c9-4877-4115-b376-77bebb8ffb8d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:24:59 devstack sudo[104464]: pam_unix(sudo:session): session closed for user root Sep 28 16:24:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b218bf35-dfdb-454f-b63c-515c179984ed tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-74149dc6-ca3e-4e3f-b80b-b5b3c2d75665-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:00 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 Sep 28 16:25:00 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:00 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:00 devstack sudo[104472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23 Sep 28 16:25:00 devstack sudo[104472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:00 devstack sudo[104472]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbfb784b-06fc-4673-98d5-31d02a31fa23" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-fbfb784b-06fc-4673-98d5-31d02a31fa23" released by "delete_volume" :: held 0.899s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['09d146d2-c284-481f-a85d-faae332b6f60', '9fddfb30-672f-446a-8db9-d86daf8c6b5a', '8115ef1e-ee92-4d30-b69f-5630660886a5', 'da664cbf-d0ba-4d53-b9a5-bd1f9c2934a6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:01 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:01 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:01 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:25:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-712f923a-d15e-4d94-a123-061a9d4ebb55 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-fbfb784b-06fc-4673-98d5-31d02a31fa23-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-0dc6696b-2e24-4ad4-8f0e-05f58f25329d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-0dc6696b-2e24-4ad4-8f0e-05f58f25329d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54762a4-6482-4326-a2db-a4185d94e09d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:02 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d Sep 28 16:25:02 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:02 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" returned: 0 in 0.508s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:02 devstack sudo[104817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d Sep 28 16:25:02 devstack sudo[104817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:03 devstack sudo[104817]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-0dc6696b-2e24-4ad4-8f0e-05f58f25329d" released by "delete_volume" :: held 0.904s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['761b3af4-89ab-4d34-ae35-4603184ad497', '3e1f8903-ea71-4b0e-9e6b-dd2cfff9fd95', 'da6b29d2-cee6-4ce2-99fb-804b965bd352', '026e05ba-2dc4-40da-8cda-8548490f870f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:03 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:03 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-887639d5-accb-4c56-b1b6-198aa4acc259-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-887639d5-accb-4c56-b1b6-198aa4acc259-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "cinder-quobyte-887639d5-accb-4c56-b1b6-198aa4acc259" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-887639d5-accb-4c56-b1b6-198aa4acc259" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f14f3de-0d2a-4db9-9b13-bca7fef9463a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:03 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:25:03 devstack sudo[104828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 Sep 28 16:25:03 devstack sudo[104828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dadac48-d780-4e8d-ac4c-f5c846ae8007 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-0dc6696b-2e24-4ad4-8f0e-05f58f25329d-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:04 devstack sudo[104828]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:04 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259 Sep 28 16:25:04 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:04 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-887639d5-accb-4c56-b1b6-198aa4acc259" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-quobyte-887639d5-accb-4c56-b1b6-198aa4acc259" released by "delete_volume" :: held 0.895s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Created reservations ['bde4562e-f2f8-40ea-8ade-a7c5f20ca92c', 'c1ab5f87-7496-439d-be28-ccbf54fa40ba', '2f2dcc9b-f35d-4e15-bbda-b4b9b8d78f44', '73fe343a-a62f-4da0-a73f-0e423bc9edc7'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:04 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:04 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:05 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:05 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Deleted volume successfully. Sep 28 16:25:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9b1f621d-2fea-4982-8998-6c6f8d5c6ab8 tempest-CreateVolumesFromSourceVolumeTest-170278365 None] Lock "cinder-887639d5-accb-4c56-b1b6-198aa4acc259-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Flow 'volume_create_manager' (61231ec2-079c-4782-98e5-b4d2f0c74021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28385751-707c-448c-a4db-091075330431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28385751-707c-448c-a4db-091075330431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744058588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79c9c50-3e39-46ce-b015-9a915bec5ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e0a0d7b4b4142962c55c599e3949e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:09Z,use_quota=True,user_id='d4102475a6604dc1b33bd67c32856ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16029294-5003-4e98-b7e9-ff447588f3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16029294-5003-4e98-b7e9-ff447588f3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1039d1b0-9a83-4e8a-93bb-2b20698a05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1039d1b0-9a83-4e8a-93bb-2b20698a05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c79c9c50-3e39-46ce-b015-9a915bec5ec9', 'volume_name': 'volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e62ce2e-1576-4743-b556-ef6a58a8256a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e62ce2e-1576-4743-b556-ef6a58a8256a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806506ef-5dd6-46af-9bfc-65d0b249e6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Volume c79c9c50-3e39-46ce-b015-9a915bec5ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9', 'volume_size': 1} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-744058588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c79c9c50-3e39-46ce-b015-9a915bec5ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e0a0d7b4b4142962c55c599e3949e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:09Z,use_quota=True,user_id='d4102475a6604dc1b33bd67c32856ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Creating volume c79c9c50-3e39-46ce-b015-9a915bec5ec9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:25:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:25:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:09 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 1073741824 Sep 28 16:25:09 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:10 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 1073741824" returned: 0 in 0.695s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:10 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 Sep 28 16:25:10 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:10 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=111,cinder:UPDATE=146,cinder:INSERT=33,cinder:DELETE=16 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806506ef-5dd6-46af-9bfc-65d0b249e6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764c56cb-0b06-4ec4-8ba8-12c55c143680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Volume volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 (c79c9c50-3e39-46ce-b015-9a915bec5ec9): created successfully Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764c56cb-0b06-4ec4-8ba8-12c55c143680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Flow 'volume_create_manager' (61231ec2-079c-4782-98e5-b4d2f0c74021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b0f6990b-9c82-4cb5-bb2d-82cf060dc9fa tempest-ProjectReaderTests-1561635055 None] Created volume successfully. Sep 28 16:25:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Acquiring lock "cinder-c79c9c50-3e39-46ce-b015-9a915bec5ec9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "cinder-c79c9c50-3e39-46ce-b015-9a915bec5ec9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:11 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=109,cinder:UPDATE=163,cinder:INSERT=38,cinder:DELETE=11 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Acquiring lock "cinder-quobyte-c79c9c50-3e39-46ce-b015-9a915bec5ec9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "cinder-quobyte-c79c9c50-3e39-46ce-b015-9a915bec5ec9" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d2cc7f-b0de-4fa7-b27b-7027df0ab5f3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:12 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 Sep 28 16:25:12 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:12 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9" returned: 0 in 0.475s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:12 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9 Sep 28 16:25:12 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:12 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c79c9c50-3e39-46ce-b015-9a915bec5ec9" returned: 0 in 0.313s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "cinder-quobyte-c79c9c50-3e39-46ce-b015-9a915bec5ec9" released by "delete_volume" :: held 0.856s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:12 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Created reservations ['b329cf2c-7903-4b0e-8edb-8c2d39db6bb8', 'fb1b3b4c-445b-4552-b564-38f8105cf1bc', '6c6bcbf9-c41e-4296-bb73-814e3c743b6b', '706e9a4e-1212-4af7-b984-9a6c4cdbbfe6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:13 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:13 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:13 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:13 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Deleted volume successfully. Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4f563671-72e1-428b-9376-1c87f7e9577c tempest-ProjectReaderTests-1561635055 None] Lock "cinder-c79c9c50-3e39-46ce-b015-9a915bec5ec9-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Flow 'volume_create_manager' (8c7c3742-92d1-4df7-a5ff-0cb5519d97e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53df758-cbb9-476a-8052-dd1250564d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a53df758-cbb9-476a-8052-dd1250564d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581603699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe88dfc-dd46-4c42-ac0d-6d069ffba60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e0a0d7b4b4142962c55c599e3949e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:14Z,use_quota=True,user_id='d4102475a6604dc1b33bd67c32856ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8ad774-f055-4040-9f21-4c5adca0607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb8ad774-f055-4040-9f21-4c5adca0607f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d0aaf4-f9b1-41f3-bc19-3b50c1002852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4d0aaf4-f9b1-41f3-bc19-3b50c1002852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe88dfc-dd46-4c42-ac0d-6d069ffba60d', 'volume_name': 'volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e564144-963c-4cc4-adf6-8ea8a16f13f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e564144-963c-4cc4-adf6-8ea8a16f13f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066ec6f-74a5-46a6-b166-da0818a8717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Volume fbe88dfc-dd46-4c42-ac0d-6d069ffba60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d', 'volume_size': 1} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581603699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe88dfc-dd46-4c42-ac0d-6d069ffba60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea9e0a0d7b4b4142962c55c599e3949e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:14Z,use_quota=True,user_id='d4102475a6604dc1b33bd67c32856ece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Creating volume fbe88dfc-dd46-4c42-ac0d-6d069ffba60d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:25:14 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:14 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d 1073741824 Sep 28 16:25:14 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:14 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d 1073741824" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:14 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d Sep 28 16:25:14 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:14 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5066ec6f-74a5-46a6-b166-da0818a8717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09ec6a3-c6ea-4e8b-9721-aa11724f1429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Volume volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d (fbe88dfc-dd46-4c42-ac0d-6d069ffba60d): created successfully Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a09ec6a3-c6ea-4e8b-9721-aa11724f1429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Flow 'volume_create_manager' (8c7c3742-92d1-4df7-a5ff-0cb5519d97e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-36e9eabb-4676-4a13-abb0-17df439b4d21 tempest-ProjectReaderTests-1561635055 None] Created volume successfully. Sep 28 16:25:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Acquiring lock "cinder-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "cinder-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Acquiring lock "cinder-quobyte-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "cinder-quobyte-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e18b1-ff6b-4217-9338-e934a28e844d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:16 devstack sudo[104995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d Sep 28 16:25:16 devstack sudo[104995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:16 devstack sudo[104995]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" returned: 0 in 0.478s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:16 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d Sep 28 16:25:16 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:16 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "cinder-quobyte-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d" released by "delete_volume" :: held 0.834s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:16 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Created reservations ['2f467d91-35a3-41a8-beda-bd4da31de315', '723072b2-0d83-4a41-be4a-2f92df293675', '931f6223-83b7-4fdd-a80e-9aa7159342b1', 'c30dae59-c948-473d-8024-481449211460'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:17 devstack sudo[105004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:17 devstack sudo[105004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:17 devstack sudo[105004]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Deleted volume successfully. Sep 28 16:25:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1a936125-7856-4521-9090-d437aa034d21 tempest-ProjectReaderTests-1561635055 None] Lock "cinder-fbe88dfc-dd46-4c42-ac0d-6d069ffba60d-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:25:27 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:27 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:DELETE=3,cinder:SELECT=9,cinder:UPDATE=19,cinder:INSERT=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Flow 'volume_create_manager' (83e8471d-fca1-4abd-8375-dae9ac53d42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f690ced3-9aa4-483c-b2fb-79039de12826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f690ced3-9aa4-483c-b2fb-79039de12826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1914226493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012a7aab-23d5-4b6a-82c6-2164a0559530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2b78d8381b4a96bb344a90fd4d88fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:29Z,use_quota=True,user_id='ba02c657583844ebb6140e8a5cfd385a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8d3b2-8b48-42be-b383-3eec9b29ea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ac8d3b2-8b48-42be-b383-3eec9b29ea33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e3551-50f8-4c7c-beb4-898261ae67c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5e3551-50f8-4c7c-beb4-898261ae67c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '012a7aab-23d5-4b6a-82c6-2164a0559530', 'volume_name': 'volume-012a7aab-23d5-4b6a-82c6-2164a0559530', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c6631-a8de-461d-8178-f528a47490c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b7c6631-a8de-461d-8178-f528a47490c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b484a32-75fe-4f58-b96a-d9262b431027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Volume 012a7aab-23d5-4b6a-82c6-2164a0559530: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-012a7aab-23d5-4b6a-82c6-2164a0559530', 'volume_size': 1} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1914226493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=012a7aab-23d5-4b6a-82c6-2164a0559530,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2b78d8381b4a96bb344a90fd4d88fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:25:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:25:29Z,use_quota=True,user_id='ba02c657583844ebb6140e8a5cfd385a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Creating volume 012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:25:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:29 devstack sudo[105008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 1073741824 Sep 28 16:25:29 devstack sudo[105008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:29 devstack sudo[105008]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 1073741824" returned: 0 in 0.532s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:29 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:25:29 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:30 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b484a32-75fe-4f58-b96a-d9262b431027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-012a7aab-23d5-4b6a-82c6-2164a0559530', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1d6bc7-4120-4a0c-9ea1-7616ab17f8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:25:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Volume volume-012a7aab-23d5-4b6a-82c6-2164a0559530 (012a7aab-23d5-4b6a-82c6-2164a0559530): created successfully Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf1d6bc7-4120-4a0c-9ea1-7616ab17f8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:25:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Flow 'volume_create_manager' (83e8471d-fca1-4abd-8375-dae9ac53d42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:25:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b3c91755-884f-47d8-99b8-e2fd70986da0 tempest-TestStampPattern-1592444161 None] Created volume successfully. Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:25:36 devstack sudo[105117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:25:36 devstack sudo[105117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:25:36 devstack sudo[105117]: pam_unix(sudo:session): session closed for user root Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.284s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:25:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:25:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:25:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:26:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-b4405dda-f451-4ef2-8bf6-2d69a476d0ac req-1d3894f3-d362-4f4c-b711-d1048eb6475e tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-b4405dda-f451-4ef2-8bf6-2d69a476d0ac req-1d3894f3-d362-4f4c-b711-d1048eb6475e tempest-TestStampPattern-1592444161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-b4405dda-f451-4ef2-8bf6-2d69a476d0ac req-1d3894f3-d362-4f4c-b711-d1048eb6475e tempest-TestStampPattern-1592444161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-b4405dda-f451-4ef2-8bf6-2d69a476d0ac req-1d3894f3-d362-4f4c-b711-d1048eb6475e tempest-TestStampPattern-1592444161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-012a7aab-23d5-4b6a-82c6-2164a0559530', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '986aeabb-4b11-4250-9de8-987eb3b1c240', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:26:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-b4405dda-f451-4ef2-8bf6-2d69a476d0ac req-1d3894f3-d362-4f4c-b711-d1048eb6475e tempest-TestStampPattern-1592444161 None] attachment_update completed successfully. Sep 28 16:26:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9aed1f1a-360f-4246-8a1a-41c7d122d510 req-f3ba92f2-134f-412b-a95b-558c1f8499b9 tempest-TestStampPattern-1592444161 None] Terminate volume connection completed successfully. Sep 28 16:26:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9aed1f1a-360f-4246-8a1a-41c7d122d510 req-f3ba92f2-134f-412b-a95b-558c1f8499b9 tempest-TestStampPattern-1592444161 None] Deleting attachment 986aeabb-4b11-4250-9de8-987eb3b1c240. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Creating offline snapshot 05142297-966b-41f4-ba86-b08be304b23c of volume 012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d855cc64-cf44-4773-9cbe-d36fb015a42b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:08 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:26:08 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:08 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:09 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c 1G Sep 28 16:26:09 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:09 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c 1G" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012a7aab-23d5-4b6a-82c6-2164a0559530 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:09 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012a7aab-23d5-4b6a-82c6-2164a0559530 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:26:09 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:09 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-012a7aab-23d5-4b6a-82c6-2164a0559530 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:09 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c is being set with open permissions: ugo+rw Sep 28 16:26:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:09 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:26:09 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:10 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.350s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:10 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info Sep 28 16:26:10 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:10 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info is being set with open permissions: ugo+rw Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:10 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info Sep 28 16:26:10 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:10 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.info" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-47a54ebc-f71f-4b94-8ceb-d6bd108d3ce4 tempest-TestStampPattern-1592444161 None] Create snapshot completed successfully Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Flow 'volume_create_manager' (bc57a50e-fc9b-495a-afe0-f450acdefd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44390d2d-01fe-4f61-9aa5-bd43a5c68339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44390d2d-01fe-4f61-9aa5-bd43a5c68339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-437180682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68bc4c74-9dad-467b-bea8-c6445fe74340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f2b78d8381b4a96bb344a90fd4d88fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=05142297-966b-41f4-ba86-b08be304b23c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:26:20Z,use_quota=True,user_id='ba02c657583844ebb6140e8a5cfd385a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe131a-df71-4227-bd04-1beb83201441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7fe131a-df71-4227-bd04-1beb83201441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7eaf5-4b6b-4eec-92a6-6b35dde66881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a7eaf5-4b6b-4eec-92a6-6b35dde66881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '68bc4c74-9dad-467b-bea8-c6445fe74340', 'volume_name': 'volume-68bc4c74-9dad-467b-bea8-c6445fe74340', 'volume_size': 1, 'snapshot_id': '05142297-966b-41f4-ba86-b08be304b23c'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04117d6-905e-4555-8337-1259a7b09c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b04117d6-905e-4555-8337-1259a7b09c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923563c6-01c3-40f0-ab92-1430c9b6849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:19 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Volume 68bc4c74-9dad-467b-bea8-c6445fe74340: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-68bc4c74-9dad-467b-bea8-c6445fe74340', 'volume_size': 1, 'snapshot_id': '05142297-966b-41f4-ba86-b08be304b23c'} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c-68bc4c74-9dad-467b-bea8-c6445fe74340" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c-68bc4c74-9dad-467b-bea8-c6445fe74340" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Creating volume 68bc4c74-9dad-467b-bea8-c6445fe74340 from snapshot 05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] snapshot: 05142297-966b-41f4-ba86-b08be304b23c, volume: 68bc4c74-9dad-467b-bea8-c6445fe74340, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd54607d-8c9e-44ee-9caa-36cd70a19505]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:26:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:20 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:26:20 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:20 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.438s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-012a7aab-23d5-4b6a-82c6-2164a0559530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[738368ec-e2e1-492c-9408-581c0c43e4f8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:20 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:26:20 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:20 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:26:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:20 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 Sep 28 16:26:20 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:29 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=13,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:26:29 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=13,cinder:UPDATE=3 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340" returned: 0 in 9.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:26:30 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Converted 1024.00 MB image at 110.28 MB/s Sep 28 16:26:30 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 is being set with open permissions: ugo+rw Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:30 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 Sep 28 16:26:30 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:30 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" released by "_copy_volume_from_snapshot" :: held 10.661s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c-68bc4c74-9dad-467b-bea8-c6445fe74340" released by "_create_volume_from_snapshot" :: held 10.761s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.780s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (923563c6-01c3-40f0-ab92-1430c9b6849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68bc4c74-9dad-467b-bea8-c6445fe74340', 'volume_size': 1, 'snapshot_id': '05142297-966b-41f4-ba86-b08be304b23c'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533cf5cd-3b31-46b5-9d78-67463a2fcd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:26:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Volume volume-68bc4c74-9dad-467b-bea8-c6445fe74340 (68bc4c74-9dad-467b-bea8-c6445fe74340): created successfully Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533cf5cd-3b31-46b5-9d78-67463a2fcd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:26:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Flow 'volume_create_manager' (bc57a50e-fc9b-495a-afe0-f450acdefd41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:26:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4928dee3-c88d-4166-9ffa-8148e811767e tempest-TestStampPattern-1592444161 None] Created volume successfully. Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:26:36 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:26:36 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:26:36 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.307s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:26:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:26:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:26:40 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:27:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9623e589-fbd4-4231-b11c-f0b3088934ef req-042aaaf8-b124-4506-be1b-3f789f7f2cd5 tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9623e589-fbd4-4231-b11c-f0b3088934ef req-042aaaf8-b124-4506-be1b-3f789f7f2cd5 tempest-TestStampPattern-1592444161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [req-9623e589-fbd4-4231-b11c-f0b3088934ef req-042aaaf8-b124-4506-be1b-3f789f7f2cd5 tempest-TestStampPattern-1592444161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-9623e589-fbd4-4231-b11c-f0b3088934ef req-042aaaf8-b124-4506-be1b-3f789f7f2cd5 tempest-TestStampPattern-1592444161 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3', 'name': 'volume-68bc4c74-9dad-467b-bea8-c6445fe74340', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7afb1a3d-7f27-4198-8a5c-719e995747f0', 'enforce_multipath': True} {{(pid=87150) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 28 16:27:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-9623e589-fbd4-4231-b11c-f0b3088934ef req-042aaaf8-b124-4506-be1b-3f789f7f2cd5 tempest-TestStampPattern-1592444161 None] attachment_update completed successfully. Sep 28 16:27:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [req-a38037d9-2e85-4ca7-98a3-4a7300cb56c0 req-f6f7dcb2-ed62-424f-b028-be3a372782a8 tempest-TestStampPattern-1592444161 None] Terminate volume connection completed successfully. Sep 28 16:27:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [req-a38037d9-2e85-4ca7-98a3-4a7300cb56c0 req-f6f7dcb2-ed62-424f-b028-be3a372782a8 tempest-TestStampPattern-1592444161 None] Deleting attachment 7afb1a3d-7f27-4198-8a5c-719e995747f0. {{(pid=87150) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-68bc4c74-9dad-467b-bea8-c6445fe74340-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "cinder-68bc4c74-9dad-467b-bea8-c6445fe74340-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea68c17-baee-4ac8-b0e2-d108585b6021]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:10 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 Sep 28 16:27:10 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:11 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:11 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340 Sep 28 16:27:11 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:11 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-68bc4c74-9dad-467b-bea8-c6445fe74340" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-68bc4c74-9dad-467b-bea8-c6445fe74340" released by "delete_volume" :: held 0.771s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Created reservations ['727f9801-a4a3-4751-bf90-acbbd7355bca', 'a8df8491-9f5d-42ae-aef3-61a0bff222a7', '57f62c1d-f627-4eeb-b31f-301af374b318', '08eea96c-89b8-4963-8c55-99f404fb2306'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:11 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:11 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:11 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:11 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Deleted volume successfully. Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-43c50cb7-46a5-445e-aa71-a25ef84472a7 tempest-TestStampPattern-1592444161 None] Lock "cinder-68bc4c74-9dad-467b-bea8-c6445fe74340-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-05142297-966b-41f4-ba86-b08be304b23c-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-05142297-966b-41f4-ba86-b08be304b23c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Deleting offline snapshot 05142297-966b-41f4-ba86-b08be304b23c of volume 012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] snapshot_file for this snap is: volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[285700dc-f2da-4c8b-96a2-ff8f99aa2a8a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:12 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:27:12 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:12 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-012a7aab-23d5-4b6a-82c6-2164a0559530(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[92464651-d78b-422b-85a4-0ad6cd918f43]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:12 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:27:12 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:13 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.591s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:13 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:27:13 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:13 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:13 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c Sep 28 16:27:13 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:14 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530.05142297-966b-41f4-ba86-b08be304b23c" returned: 0 in 0.315s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-05142297-966b-41f4-ba86-b08be304b23c" released by "_delete_snapshot" :: held 1.789s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" released by "delete_snapshot" :: held 1.822s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Created reservations ['adad9396-0214-43d7-9ca7-4c3fa56695bd', 'c158d066-2a9d-4a4b-8842-cd6aa7484678', 'b9038422-594a-498b-a0a2-0fb946ec86e1', 'af817332-2cb7-4c15-9ad0-05f71bc9393b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Delete snapshot completed successfully. Sep 28 16:27:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-200937ee-046d-4e16-b936-e63223b13c42 tempest-TestStampPattern-1592444161 None] Lock "cinder-05142297-966b-41f4-ba86-b08be304b23c-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-012a7aab-23d5-4b6a-82c6-2164a0559530-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "cinder-012a7aab-23d5-4b6a-82c6-2164a0559530-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Acquiring lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962909d-0025-4d64-9074-c6aca6a7a850]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:18 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:27:18 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:18 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:18 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530 Sep 28 16:27:18 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:19 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-012a7aab-23d5-4b6a-82c6-2164a0559530" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "cinder-quobyte-012a7aab-23d5-4b6a-82c6-2164a0559530" released by "delete_volume" :: held 0.760s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Created reservations ['6b0e09e8-ac74-4a22-8d0c-b42339bae2ba', '14b9d1d1-3833-49dd-b075-bfc23b89ef39', '61bcede2-68e4-4ea6-9792-259692646c9f', '36e1f6a6-c611-4d94-a95b-67d605d08bc5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:19 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:19 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:19 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Deleted volume successfully. Sep 28 16:27:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-69327101-8c9f-44ec-97a4-7efd4284d5ce tempest-TestStampPattern-1592444161 None] Lock "cinder-012a7aab-23d5-4b6a-82c6-2164a0559530-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:29 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=29,cinder:UPDATE=23,cinder:INSERT=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:27:29 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=17,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (0d7e3022-9312-428f-a802-6992f1d57cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ccb3be-03e3-430c-bab2-d55c79dceb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4ccb3be-03e3-430c-bab2-d55c79dceb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167069673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af4d0ad-6084-4112-af8a-9d351d81af61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:32Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f1d9f-07fc-444e-836e-5c1969f77c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (306f1d9f-07fc-444e-836e-5c1969f77c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c1d74e-17b8-4d2b-9b20-e0ae8c14bb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7c1d74e-17b8-4d2b-9b20-e0ae8c14bb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af4d0ad-6084-4112-af8a-9d351d81af61', 'volume_name': 'volume-1af4d0ad-6084-4112-af8a-9d351d81af61', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf9c79a-e40f-4bcd-89fe-3b90f0d894b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf9c79a-e40f-4bcd-89fe-3b90f0d894b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55122fd-1f64-40a3-83d9-0ba4d4037f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Volume 1af4d0ad-6084-4112-af8a-9d351d81af61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af4d0ad-6084-4112-af8a-9d351d81af61', 'volume_size': 1} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167069673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af4d0ad-6084-4112-af8a-9d351d81af61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:32Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Creating volume 1af4d0ad-6084-4112-af8a-9d351d81af61 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:32 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 1073741824 Sep 28 16:27:32 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (3c760a11-52fc-4c9b-ac40-02b773c73dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19d916a-8e34-4994-b2ee-4d59bdcf91eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f19d916a-8e34-4994-b2ee-4d59bdcf91eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1495721636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aa637c-9d40-427c-9172-70917b9ecdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c518d6-897a-43da-a71a-05f4f01289d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c518d6-897a-43da-a71a-05f4f01289d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e76d4-ede1-4090-a3e9-b2f39aceab50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4e76d4-ede1-4090-a3e9-b2f39aceab50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9aa637c-9d40-427c-9172-70917b9ecdbe', 'volume_name': 'volume-f9aa637c-9d40-427c-9172-70917b9ecdbe', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7dc941-4d4e-4bf9-b57d-6845d4146b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7dc941-4d4e-4bf9-b57d-6845d4146b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3be765-67e9-4ef8-8f36-0cca4d7258ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Volume f9aa637c-9d40-427c-9172-70917b9ecdbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9aa637c-9d40-427c-9172-70917b9ecdbe', 'volume_size': 1} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:32 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 1073741824" returned: 0 in 0.554s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:32 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 Sep 28 16:27:32 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (94e2df2c-34d3-4fe0-873f-0f34736b62be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfdeaba-6ced-4748-8123-e85c6f43681e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdfdeaba-6ced-4748-8123-e85c6f43681e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241099443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d62a11c-77c0-4fba-a1b4-41700b293d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac833ef-052d-4b0b-9db9-3698f08ec69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac833ef-052d-4b0b-9db9-3698f08ec69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077fb8f1-790d-4bd7-9610-8ae4f2f47302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077fb8f1-790d-4bd7-9610-8ae4f2f47302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d62a11c-77c0-4fba-a1b4-41700b293d46', 'volume_name': 'volume-4d62a11c-77c0-4fba-a1b4-41700b293d46', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73be22f-ff1c-4dde-be50-93689695254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73be22f-ff1c-4dde-be50-93689695254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689e6f4-61e8-4f31-94dc-ddff085510a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Volume 4d62a11c-77c0-4fba-a1b4-41700b293d46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d62a11c-77c0-4fba-a1b4-41700b293d46', 'volume_size': 1} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:33 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.540s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1495721636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9aa637c-9d40-427c-9172-70917b9ecdbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Creating volume f9aa637c-9d40-427c-9172-70917b9ecdbe {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d55122fd-1f64-40a3-83d9-0ba4d4037f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af4d0ad-6084-4112-af8a-9d351d81af61', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe 1073741824 Sep 28 16:27:33 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a24959-08f6-4bd2-bbbd-49ab3f8e88f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Volume volume-1af4d0ad-6084-4112-af8a-9d351d81af61 (1af4d0ad-6084-4112-af8a-9d351d81af61): created successfully Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63a24959-08f6-4bd2-bbbd-49ab3f8e88f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (0d7e3022-9312-428f-a802-6992f1d57cc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-77d7706f-b749-4a79-9a01-6a53871630e8 tempest-CreateVolumesFromImageTest-1569430871 None] Created volume successfully. Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (fb0972c8-c16f-4f92-9cb6-21278ee55c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80070b13-5522-44ea-a4d3-cdd458d36c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80070b13-5522-44ea-a4d3-cdd458d36c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428246983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af4e735-2519-4258-9088-3845ad83c194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8d97cb-cdf1-4414-841e-77ebe9b66d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8d97cb-cdf1-4414-841e-77ebe9b66d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c510f072-10ff-47b8-bbf7-6f3e2f6071ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c510f072-10ff-47b8-bbf7-6f3e2f6071ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0af4e735-2519-4258-9088-3845ad83c194', 'volume_name': 'volume-0af4e735-2519-4258-9088-3845ad83c194', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07d8b58-2954-4f96-8be6-7e437c289943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07d8b58-2954-4f96-8be6-7e437c289943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9542b446-8043-4151-8ac6-d49f5545f8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Volume 0af4e735-2519-4258-9088-3845ad83c194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0af4e735-2519-4258-9088-3845ad83c194', 'volume_size': 1} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:33 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe 1073741824" returned: 0 in 0.539s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (2d71e31b-669f-4d33-80b8-1c6f940e1a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8c6f0-12e7-49b4-8773-5e00104201b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b8c6f0-12e7-49b4-8773-5e00104201b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375619538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d76d29-17eb-4829-959b-7befd2f71730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:34Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe Sep 28 16:27:33 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abaa6c6-9e61-4674-952c-dfbadad942fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7abaa6c6-9e61-4674-952c-dfbadad942fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c880be7-2381-47b3-bc86-a3f3da179014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c880be7-2381-47b3-bc86-a3f3da179014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d76d29-17eb-4829-959b-7befd2f71730', 'volume_name': 'volume-93d76d29-17eb-4829-959b-7befd2f71730', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc169a0-44d5-4af6-b094-cc12ed1b2f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fc169a0-44d5-4af6-b094-cc12ed1b2f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3268b25-05fd-4c2e-ae07-bba66a3adbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Volume 93d76d29-17eb-4829-959b-7befd2f71730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d76d29-17eb-4829-959b-7befd2f71730', 'volume_size': 1} Sep 28 16:27:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:34 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1241099443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d62a11c-77c0-4fba-a1b4-41700b293d46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Creating volume 4d62a11c-77c0-4fba-a1b4-41700b293d46 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3be765-67e9-4ef8-8f36-0cca4d7258ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9aa637c-9d40-427c-9172-70917b9ecdbe', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:34 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 1073741824 Sep 28 16:27:34 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13efa90-477f-4309-8143-cb3b95e87f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Volume volume-f9aa637c-9d40-427c-9172-70917b9ecdbe (f9aa637c-9d40-427c-9172-70917b9ecdbe): created successfully Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13efa90-477f-4309-8143-cb3b95e87f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (3c760a11-52fc-4c9b-ac40-02b773c73dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-02c39d3a-9d01-4590-86a1-183b17be36b7 tempest-CreateVolumesFromImageTest-1569430871 None] Created volume successfully. Sep 28 16:27:34 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 1073741824" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:34 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 Sep 28 16:27:34 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:34 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.749s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-428246983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0af4e735-2519-4258-9088-3845ad83c194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:33Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Creating volume 0af4e735-2519-4258-9088-3845ad83c194 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c689e6f4-61e8-4f31-94dc-ddff085510a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d62a11c-77c0-4fba-a1b4-41700b293d46', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4368859a-8773-4352-9382-5b216de68793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:34 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 1073741824 Sep 28 16:27:34 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Volume volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 (4d62a11c-77c0-4fba-a1b4-41700b293d46): created successfully Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4368859a-8773-4352-9382-5b216de68793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (94e2df2c-34d3-4fe0-873f-0f34736b62be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8279489b-3b52-45c6-8ceb-36754614ccbf tempest-CreateVolumesFromImageTest-1569430871 None] Created volume successfully. Sep 28 16:27:35 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 1073741824" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:35 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 Sep 28 16:27:35 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:35 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.757s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1375619538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d76d29-17eb-4829-959b-7befd2f71730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91ac680923394b29beb0accdab251c98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:34Z,use_quota=True,user_id='1cdda36f3f994b748c53b9991a500474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Creating volume 93d76d29-17eb-4829-959b-7befd2f71730 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:35 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:35 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 1073741824 Sep 28 16:27:35 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9542b446-8043-4151-8ac6-d49f5545f8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0af4e735-2519-4258-9088-3845ad83c194', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2c3574-5940-404c-a50e-ec104dcf02f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:35 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Volume volume-0af4e735-2519-4258-9088-3845ad83c194 (0af4e735-2519-4258-9088-3845ad83c194): created successfully Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2c3574-5940-404c-a50e-ec104dcf02f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:35 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (fb0972c8-c16f-4f92-9cb6-21278ee55c9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6b96f911-9066-4f28-982d-35148e85ee50 tempest-CreateVolumesFromImageTest-1569430871 None] Created volume successfully. Sep 28 16:27:36 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 1073741824" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:36 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 Sep 28 16:27:36 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:36 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3268b25-05fd-4c2e-ae07-bba66a3adbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d76d29-17eb-4829-959b-7befd2f71730', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932bddf5-5c87-49a1-9761-07dc6f11978a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Volume volume-93d76d29-17eb-4829-959b-7befd2f71730 (93d76d29-17eb-4829-959b-7befd2f71730): created successfully Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (932bddf5-5c87-49a1-9761-07dc6f11978a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Flow 'volume_create_manager' (2d71e31b-669f-4d33-80b8-1c6f940e1a23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-864b7c30-34a6-430e-bc0e-b0426002707c tempest-CreateVolumesFromImageTest-1569430871 None] Created volume successfully. Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:36 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:36 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:36 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:27:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-93d76d29-17eb-4829-959b-7befd2f71730-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-93d76d29-17eb-4829-959b-7befd2f71730-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-quobyte-93d76d29-17eb-4829-959b-7befd2f71730" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-93d76d29-17eb-4829-959b-7befd2f71730" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[131468c4-56f3-4dd7-a0b8-244baacbcd57]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:37 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 Sep 28 16:27:37 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:37 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730" returned: 0 in 0.390s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:37 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730 Sep 28 16:27:37 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:38 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-93d76d29-17eb-4829-959b-7befd2f71730" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-93d76d29-17eb-4829-959b-7befd2f71730" released by "delete_volume" :: held 0.736s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Created reservations ['338a69bb-7047-4fa8-8fd8-008d7b966ed9', '09672a0f-7b45-4a37-95df-2eb5bf2204df', '00aba203-7364-4a48-b58c-072c5abf0f11', '087ca602-9dd9-46be-8b18-ed52d63ae743'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:38 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:38 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:38 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-0af4e735-2519-4258-9088-3845ad83c194-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:38 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Deleted volume successfully. Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-0af4e735-2519-4258-9088-3845ad83c194-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1b6733db-2743-4fe9-ac71-96be5f2e9d4e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-93d76d29-17eb-4829-959b-7befd2f71730-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-quobyte-0af4e735-2519-4258-9088-3845ad83c194" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-0af4e735-2519-4258-9088-3845ad83c194" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ace2692-9b34-428d-8bc7-258a12c6f824]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:38 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 Sep 28 16:27:38 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:38 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:38 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194 Sep 28 16:27:38 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:39 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0af4e735-2519-4258-9088-3845ad83c194" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-0af4e735-2519-4258-9088-3845ad83c194" released by "delete_volume" :: held 0.684s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Created reservations ['0d5f2e8e-4af0-4d29-a3af-d520acc88884', 'ff6b48b6-8e46-4af6-bcc0-111adadb1267', '3c2b6461-f8df-4d76-8016-fce8fd3e210e', '6ec40842-a721-4a55-a4d7-851c0a63ca40'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:39 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:39 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-4d62a11c-77c0-4fba-a1b4-41700b293d46-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-4d62a11c-77c0-4fba-a1b4-41700b293d46-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:39 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Deleted volume successfully. Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-quobyte-4d62a11c-77c0-4fba-a1b4-41700b293d46" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d200e238-a9df-48fe-b74c-1d690718d28e tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-0af4e735-2519-4258-9088-3845ad83c194-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-4d62a11c-77c0-4fba-a1b4-41700b293d46" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7864b5e3-1324-4868-8b3a-fac175a10ba2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:39 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 Sep 28 16:27:39 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:40 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:40 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46 Sep 28 16:27:40 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:40 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-4d62a11c-77c0-4fba-a1b4-41700b293d46" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-4d62a11c-77c0-4fba-a1b4-41700b293d46" released by "delete_volume" :: held 0.682s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Created reservations ['1eaaf679-2852-4069-8c37-0c4bf7801d32', '4f8fb6dc-29fb-4147-8fb2-38584682db74', '7b4bb328-0789-40bb-a01e-c46aa045f7f5', '31b62e2c-3c41-407a-95d4-8e5eeec66588'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:40 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:40 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:40 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.300s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-f9aa637c-9d40-427c-9172-70917b9ecdbe-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Deleted volume successfully. Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-f9aa637c-9d40-427c-9172-70917b9ecdbe-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d8686cc4-930b-47c0-ad82-be990678808d tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-4d62a11c-77c0-4fba-a1b4-41700b293d46-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-quobyte-f9aa637c-9d40-427c-9172-70917b9ecdbe" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-f9aa637c-9d40-427c-9172-70917b9ecdbe" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d191cea6-4e6f-4285-a04e-bb129d1e9c2d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:41 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe Sep 28 16:27:41 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:41 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:41 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe Sep 28 16:27:41 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:41 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f9aa637c-9d40-427c-9172-70917b9ecdbe" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-f9aa637c-9d40-427c-9172-70917b9ecdbe" released by "delete_volume" :: held 0.685s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Created reservations ['2260dc9f-f430-4668-83a2-66a0538ec17a', '0eaf2017-f8e4-4c23-81f0-77231ada446c', '0b2bb7c8-5d9c-4eaa-958d-9fd7b2bcc867', 'a2f941ec-0c89-46a4-b66b-de5509046163'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:41 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:41 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-1af4d0ad-6084-4112-af8a-9d351d81af61-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-1af4d0ad-6084-4112-af8a-9d351d81af61-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "cinder-quobyte-1af4d0ad-6084-4112-af8a-9d351d81af61" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-1af4d0ad-6084-4112-af8a-9d351d81af61" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3505e1e4-b78d-4e62-b10a-fe7b6065e224]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:42 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Deleted volume successfully. Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b634b43e-0b98-4616-bbca-e40e1e95c7af tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-f9aa637c-9d40-427c-9172-70917b9ecdbe-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:42 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 Sep 28 16:27:42 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:42 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:42 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61 Sep 28 16:27:42 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:42 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1af4d0ad-6084-4112-af8a-9d351d81af61" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-quobyte-1af4d0ad-6084-4112-af8a-9d351d81af61" released by "delete_volume" :: held 0.708s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Created reservations ['f36d5d9c-d0d3-4ffb-bbb9-99e9243ab663', '87952068-4b3c-4f85-8ada-ad7ca4142151', '8a888ff3-6662-4ffb-8615-b4b9914101ee', '8870c33f-8c5c-4f9d-9ee6-05c5c8bfd263'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:42 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:42 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:43 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Deleted volume successfully. Sep 28 16:27:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-5c45fbae-520c-4bc2-827d-ffe80aa740db tempest-CreateVolumesFromImageTest-1569430871 None] Lock "cinder-1af4d0ad-6084-4112-af8a-9d351d81af61-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=36,cinder:UPDATE=52,cinder:DELETE=3,cinder:INSERT=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=35,cinder:UPDATE=59,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (2b6243d6-e03c-4e20-9eb5-7899c222b68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49d358a-1f6c-4d71-8893-ca871c216809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49d358a-1f6c-4d71-8893-ca871c216809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97861227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b140db6d-110f-4888-b211-8ddb90bf39d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:56Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3cf935-267e-4c48-a8d4-01554f0d659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3cf935-267e-4c48-a8d4-01554f0d659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70909246-556c-4d5c-895e-6177e910a6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70909246-556c-4d5c-895e-6177e910a6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b140db6d-110f-4888-b211-8ddb90bf39d0', 'volume_name': 'volume-b140db6d-110f-4888-b211-8ddb90bf39d0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b756f6b-8ce5-47bd-bbdc-3e5546dbc4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b756f6b-8ce5-47bd-bbdc-3e5546dbc4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0e690-d09b-463c-8d94-0a030ff4fd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:55 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Volume b140db6d-110f-4888-b211-8ddb90bf39d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b140db6d-110f-4888-b211-8ddb90bf39d0', 'volume_size': 1} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97861227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b140db6d-110f-4888-b211-8ddb90bf39d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:56Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Creating volume b140db6d-110f-4888-b211-8ddb90bf39d0 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:55 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:55 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 1073741824 Sep 28 16:27:55 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:56 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 1073741824" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:56 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 Sep 28 16:27:56 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:56 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ae0e690-d09b-463c-8d94-0a030ff4fd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b140db6d-110f-4888-b211-8ddb90bf39d0', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3f90d9-ff50-45bd-ace6-674947511284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:56 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Volume volume-b140db6d-110f-4888-b211-8ddb90bf39d0 (b140db6d-110f-4888-b211-8ddb90bf39d0): created successfully Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3f90d9-ff50-45bd-ace6-674947511284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (2b6243d6-e03c-4e20-9eb5-7899c222b68d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:56 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a37cabf1-5051-4465-9975-df25b69641d9 tempest-ProjectReaderTests-1568445424 None] Created volume successfully. Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-b140db6d-110f-4888-b211-8ddb90bf39d0-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "cinder-b140db6d-110f-4888-b211-8ddb90bf39d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-quobyte-b140db6d-110f-4888-b211-8ddb90bf39d0" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-b140db6d-110f-4888-b211-8ddb90bf39d0" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[492310f2-1d7d-46fa-a2c2-7fbdaca94896]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:56 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 Sep 28 16:27:56 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:57 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:57 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0 Sep 28 16:27:57 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:57 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b140db6d-110f-4888-b211-8ddb90bf39d0" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-b140db6d-110f-4888-b211-8ddb90bf39d0" released by "delete_volume" :: held 0.661s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Created reservations ['98f59e03-6471-4129-9b0b-79425b93bdc9', 'd0a52fd6-c5c3-4823-affd-0300713a15c2', '01dfe85f-c496-42cd-84d4-381b8151b83b', '2bd75092-2e94-41df-8167-01b58d1008f8'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:57 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:27:57 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:57 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:27:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Deleted volume successfully. Sep 28 16:27:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-81e688d7-a84e-4d98-beff-a8d41fb9786c tempest-ProjectReaderTests-1568445424 None] Lock "cinder-b140db6d-110f-4888-b211-8ddb90bf39d0-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (c741d24f-ff34-4afa-a830-bf5aab567756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de6655c-c9cd-4b32-89fa-848062fc4a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7de6655c-c9cd-4b32-89fa-848062fc4a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529971682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ef2eb-f47b-407d-805b-654015181bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:58Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c197d5-0a62-4d3f-a44f-f9e5c7f4be7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0c197d5-0a62-4d3f-a44f-f9e5c7f4be7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eda5e1-4f50-4669-8129-edc6aa014f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1eda5e1-4f50-4669-8129-edc6aa014f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972ef2eb-f47b-407d-805b-654015181bbf', 'volume_name': 'volume-972ef2eb-f47b-407d-805b-654015181bbf', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512ad83d-3794-4892-a9b0-3d9fd6536318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (512ad83d-3794-4892-a9b0-3d9fd6536318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23029989-8b5c-4942-9d25-4fd2b9a1aa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Volume 972ef2eb-f47b-407d-805b-654015181bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972ef2eb-f47b-407d-805b-654015181bbf', 'volume_size': 1} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1529971682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ef2eb-f47b-407d-805b-654015181bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:27:58Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Creating volume 972ef2eb-f47b-407d-805b-654015181bbf {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:27:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:58 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf 1073741824 Sep 28 16:27:58 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:58 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf 1073741824" returned: 0 in 0.427s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:58 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf Sep 28 16:27:58 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:59 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23029989-8b5c-4942-9d25-4fd2b9a1aa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972ef2eb-f47b-407d-805b-654015181bbf', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26976297-eb2f-4ae1-baee-efe5bcb9e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:27:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Volume volume-972ef2eb-f47b-407d-805b-654015181bbf (972ef2eb-f47b-407d-805b-654015181bbf): created successfully Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26976297-eb2f-4ae1-baee-efe5bcb9e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (c741d24f-ff34-4afa-a830-bf5aab567756) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:27:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7ced20c4-e095-4c33-98da-a3b94ce6b02a tempest-ProjectReaderTests-1568445424 None] Created volume successfully. Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-972ef2eb-f47b-407d-805b-654015181bbf-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "cinder-972ef2eb-f47b-407d-805b-654015181bbf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-quobyte-972ef2eb-f47b-407d-805b-654015181bbf" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-972ef2eb-f47b-407d-805b-654015181bbf" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d5321b-408f-43f8-b7e4-472a6ab0a9c3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:59 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf Sep 28 16:27:59 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:27:59 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:27:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:27:59 devstack sudo[106661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf Sep 28 16:27:59 devstack sudo[106661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:00 devstack sudo[106661]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-972ef2eb-f47b-407d-805b-654015181bbf" returned: 0 in 0.268s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-972ef2eb-f47b-407d-805b-654015181bbf" released by "delete_volume" :: held 0.702s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Created reservations ['b8e2594e-a184-4872-a4c6-4475d019f689', '790a7796-6bfd-460b-add5-66746910e3a6', '06b2edf7-0749-48dd-8070-f4746f8d8ae9', '55b7bef7-3c11-4d83-b0b1-f773655c4872'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:00 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:00 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:00 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.282s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Deleted volume successfully. Sep 28 16:28:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd8dfd-5f19-423f-a8d3-125721243f6a tempest-ProjectReaderTests-1568445424 None] Lock "cinder-972ef2eb-f47b-407d-805b-654015181bbf-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (94d91ff0-8f23-48c8-a724-588042e5e15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac97b85-b75e-4803-a1f0-a978ae516069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ac97b85-b75e-4803-a1f0-a978ae516069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410331857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2934d67a-7c68-4730-aa81-b6353e335936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:01Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8737c56e-4436-43c4-9710-a07eed5e4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8737c56e-4436-43c4-9710-a07eed5e4c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1d2953-d982-442d-ab68-b4bca6cf88c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1d2953-d982-442d-ab68-b4bca6cf88c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2934d67a-7c68-4730-aa81-b6353e335936', 'volume_name': 'volume-2934d67a-7c68-4730-aa81-b6353e335936', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85d7db8-258e-4412-9ad1-35521f92f50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85d7db8-258e-4412-9ad1-35521f92f50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7aa62b-1b42-4e33-b54c-81b80d574653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:01 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Volume 2934d67a-7c68-4730-aa81-b6353e335936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2934d67a-7c68-4730-aa81-b6353e335936', 'volume_size': 1} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1410331857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2934d67a-7c68-4730-aa81-b6353e335936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:01Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Creating volume 2934d67a-7c68-4730-aa81-b6353e335936 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:01 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:01 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 1073741824 Sep 28 16:28:01 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:02 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 1073741824" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:02 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 Sep 28 16:28:02 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:02 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936" returned: 0 in 0.258s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7aa62b-1b42-4e33-b54c-81b80d574653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2934d67a-7c68-4730-aa81-b6353e335936', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5467f4cf-b5e2-4b9d-8c4a-ce2fbd27c4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:02 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Volume volume-2934d67a-7c68-4730-aa81-b6353e335936 (2934d67a-7c68-4730-aa81-b6353e335936): created successfully Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5467f4cf-b5e2-4b9d-8c4a-ce2fbd27c4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (94d91ff0-8f23-48c8-a724-588042e5e15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fdab2f36-c033-471a-9902-5bdd5f77e026 tempest-ProjectReaderTests-1568445424 None] Created volume successfully. Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-2934d67a-7c68-4730-aa81-b6353e335936-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "cinder-2934d67a-7c68-4730-aa81-b6353e335936-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-quobyte-2934d67a-7c68-4730-aa81-b6353e335936" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-2934d67a-7c68-4730-aa81-b6353e335936" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0019cf-9fc1-4a45-ad04-d00cd9be4d2e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:03 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 Sep 28 16:28:03 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:03 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:03 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936 Sep 28 16:28:03 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:03 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-2934d67a-7c68-4730-aa81-b6353e335936" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-2934d67a-7c68-4730-aa81-b6353e335936" released by "delete_volume" :: held 0.691s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Created reservations ['c29cad52-0c5d-4cc0-a838-6e5320305b94', '8a397e71-8652-494e-b16a-08478634fde8', '67790d3e-9be0-4cc3-a6f8-9684134eed61', '4add6c5f-9df4-4316-8511-a871e3b4659c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:03 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:03 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:03 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Deleted volume successfully. Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7bbdf158-0dbd-4e13-97bd-b31980a3e3cc tempest-ProjectReaderTests-1568445424 None] Lock "cinder-2934d67a-7c68-4730-aa81-b6353e335936-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (adef6ecc-b7cc-452d-bdb4-cfcf63090906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3540ba-c6a5-46f9-9100-f2e81834f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3540ba-c6a5-46f9-9100-f2e81834f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688778955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c42ee5-a350-4bd7-b5db-52ac416425c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:04Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a8e3cf-9f64-41ca-b341-6d6a0e8ee584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51a8e3cf-9f64-41ca-b341-6d6a0e8ee584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a1b0c3-e800-4887-890d-1d0777cc7034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97a1b0c3-e800-4887-890d-1d0777cc7034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c42ee5-a350-4bd7-b5db-52ac416425c4', 'volume_name': 'volume-89c42ee5-a350-4bd7-b5db-52ac416425c4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ff6902-d2c9-4faf-87a3-e319e44a2c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32ff6902-d2c9-4faf-87a3-e319e44a2c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad6c51-4b88-453e-95a3-a5ac44dc93ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Volume 89c42ee5-a350-4bd7-b5db-52ac416425c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c42ee5-a350-4bd7-b5db-52ac416425c4', 'volume_size': 1} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1688778955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c42ee5-a350-4bd7-b5db-52ac416425c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c4d438154e6436a94b4f77426de955d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:04Z,use_quota=True,user_id='bd89ea9a11cf4bbe8398f12277ad5a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Creating volume 89c42ee5-a350-4bd7-b5db-52ac416425c4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:04 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:04 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 1073741824 Sep 28 16:28:04 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:04 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 1073741824" returned: 0 in 0.445s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:05 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 Sep 28 16:28:05 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:05 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42ad6c51-4b88-453e-95a3-a5ac44dc93ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c42ee5-a350-4bd7-b5db-52ac416425c4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673cd72a-345b-4699-8600-38736108b90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Volume volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 (89c42ee5-a350-4bd7-b5db-52ac416425c4): created successfully Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673cd72a-345b-4699-8600-38736108b90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Flow 'volume_create_manager' (adef6ecc-b7cc-452d-bdb4-cfcf63090906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-155dc60a-89bf-4df8-ab61-2d11c2a909d3 tempest-ProjectReaderTests-1568445424 None] Created volume successfully. Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-89c42ee5-a350-4bd7-b5db-52ac416425c4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "cinder-89c42ee5-a350-4bd7-b5db-52ac416425c4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "cinder-quobyte-89c42ee5-a350-4bd7-b5db-52ac416425c4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-89c42ee5-a350-4bd7-b5db-52ac416425c4" acquired by "delete_volume" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a147de8-1a87-4f5c-a114-7e79f6e65f72]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:05 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 Sep 28 16:28:05 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:05 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:05 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4 Sep 28 16:28:05 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:06 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-89c42ee5-a350-4bd7-b5db-52ac416425c4" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "cinder-quobyte-89c42ee5-a350-4bd7-b5db-52ac416425c4" released by "delete_volume" :: held 0.695s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Created reservations ['a85e4541-6a01-41bb-af19-d5aea1812950', '41e6b2e0-98a5-46fc-8926-9cb78238246a', 'a45da826-bd02-4fd5-841b-0bf5a5407830', '0cb636e9-1ac0-422c-9830-a923496750ca'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:06 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:06 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:06 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Deleted volume successfully. Sep 28 16:28:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-37b7a466-db6b-4e80-ba20-0a7cc8820e55 tempest-ProjectReaderTests-1568445424 None] Lock "cinder-89c42ee5-a350-4bd7-b5db-52ac416425c4-delete_volume" released by "delete_volume" :: held 1.143s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:16 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=31,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=2 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:28:16 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=49,cinder:SELECT=25,cinder:DELETE=6,cinder:INSERT=10 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (55c4bcc8-70e6-4baa-bf6c-01c1325e9492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42af7404-1332-4ddf-9c36-25e5c76bd678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42af7404-1332-4ddf-9c36-25e5c76bd678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781657271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b9bfd-90cb-477c-8437-246cbedc20c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:22Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ea31e-e40d-4862-bc8b-9aad0d350186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c3ea31e-e40d-4862-bc8b-9aad0d350186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6e27b3-aa37-49a1-b992-80adb3cdfbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e6e27b3-aa37-49a1-b992-80adb3cdfbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421b9bfd-90cb-477c-8437-246cbedc20c5', 'volume_name': 'volume-421b9bfd-90cb-477c-8437-246cbedc20c5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934cfd7e-c67a-4154-aec0-d419d3714313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (934cfd7e-c67a-4154-aec0-d419d3714313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dc6a8c-f2a9-4c36-8064-4033ae0c9466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume 421b9bfd-90cb-477c-8437-246cbedc20c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421b9bfd-90cb-477c-8437-246cbedc20c5', 'volume_size': 1} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1781657271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=421b9bfd-90cb-477c-8437-246cbedc20c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:22Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume 421b9bfd-90cb-477c-8437-246cbedc20c5 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:22 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:22 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 1073741824 Sep 28 16:28:22 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (51b76947-1690-4ee7-a3b0-5710e0b5d759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c2ff17-50f7-4322-a206-4520868a6dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9c2ff17-50f7-4322-a206-4520868a6dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1584990041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa3c795-04bc-4bff-a1c6-b06c747e564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb84840-d777-43b3-bb6e-9985f7d14757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfb84840-d777-43b3-bb6e-9985f7d14757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae7d21f-6dd4-448d-80aa-51c03f38c473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aae7d21f-6dd4-448d-80aa-51c03f38c473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aa3c795-04bc-4bff-a1c6-b06c747e564b', 'volume_name': 'volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f28ab11-0924-44fc-b286-55f19843c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f28ab11-0924-44fc-b286-55f19843c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bfafe7-c8d1-4bde-a02f-4aed5dc1a80f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Volume 0aa3c795-04bc-4bff-a1c6-b06c747e564b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b', 'volume_size': 1} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (93e04896-a8bb-4909-9e86-3b762ec4cbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae472af7-c4a6-4c62-9e17-f9802204aec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae472af7-c4a6-4c62-9e17-f9802204aec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596981756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15409f1-f910-4511-a0ba-d1fece64a8b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63b2b86-f2fc-459e-a922-d0cf9f5d924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63b2b86-f2fc-459e-a922-d0cf9f5d924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5a0688-b418-4fd3-b456-02def0c2ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f5a0688-b418-4fd3-b456-02def0c2ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15409f1-f910-4511-a0ba-d1fece64a8b6', 'volume_name': 'volume-b15409f1-f910-4511-a0ba-d1fece64a8b6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f530f7d-066b-453e-8cb6-b039847917e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f530f7d-066b-453e-8cb6-b039847917e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4cc8b0-e3db-4974-81c3-af92526b3829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:22 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Volume b15409f1-f910-4511-a0ba-d1fece64a8b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15409f1-f910-4511-a0ba-d1fece64a8b6', 'volume_size': 1} Sep 28 16:28:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Flow 'volume_create_manager' (e5edd675-41bc-45f8-8a13-a94b2fdd6860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbd4fba-3174-4f0a-97e1-f05fe05b7825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adbd4fba-3174-4f0a-97e1-f05fe05b7825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353758262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a5297a-35f0-4782-b5df-2d7a16ad77c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65cb6d59fd8446ab36daee5ac5718a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='584776c3d8c9489b98641ed36fcb338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160160ef-782d-401b-9da8-0e9337c3a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (160160ef-782d-401b-9da8-0e9337c3a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2654f28b-2f2b-469a-a207-3ac79b883017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2654f28b-2f2b-469a-a207-3ac79b883017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2a5297a-35f0-4782-b5df-2d7a16ad77c6', 'volume_name': 'volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd08fcd3-eaf0-42ca-b0f3-cf4aa4db4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd08fcd3-eaf0-42ca-b0f3-cf4aa4db4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72546d1-c535-4e38-8a8f-7bfb782c0922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Volume b2a5297a-35f0-4782-b5df-2d7a16ad77c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6', 'volume_size': 1} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 1073741824" returned: 0 in 0.812s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:23 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 Sep 28 16:28:23 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (2359c065-2a5b-4015-a191-adc03d9dbfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d825e3-d57d-4ddd-9f18-9fe3b322e9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d825e3-d57d-4ddd-9f18-9fe3b322e9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810807605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ce31d1-e6ba-456c-9264-957d99f81e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:24Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c191f7-3fa3-4b97-9053-61d9594ba94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31c191f7-3fa3-4b97-9053-61d9594ba94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa339ae1-d6fd-45fc-96c3-3b15b57c4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa339ae1-d6fd-45fc-96c3-3b15b57c4167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79ce31d1-e6ba-456c-9264-957d99f81e8d', 'volume_name': 'volume-79ce31d1-e6ba-456c-9264-957d99f81e8d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912b444b-6630-4b39-aec6-d76080b6d538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (912b444b-6630-4b39-aec6-d76080b6d538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b7560c-9f76-40a9-ad69-da8392da582a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Volume 79ce31d1-e6ba-456c-9264-957d99f81e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79ce31d1-e6ba-456c-9264-957d99f81e8d', 'volume_size': 1} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:23 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.232s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1584990041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aa3c795-04bc-4bff-a1c6-b06c747e564b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Creating volume 0aa3c795-04bc-4bff-a1c6-b06c747e564b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:23 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2dc6a8c-f2a9-4c36-8064-4033ae0c9466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421b9bfd-90cb-477c-8437-246cbedc20c5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b 1073741824 Sep 28 16:28:23 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2980a219-553b-4557-8588-c4520e16a959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:23 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-421b9bfd-90cb-477c-8437-246cbedc20c5 (421b9bfd-90cb-477c-8437-246cbedc20c5): created successfully Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2980a219-553b-4557-8588-c4520e16a959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:23 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (55c4bcc8-70e6-4baa-bf6c-01c1325e9492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d3c42f0c-6093-4ddd-a45b-a780d189aef8 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (9433e4c2-4946-45f1-b2c3-7986ac84a4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa8831-3d67-4382-8043-78980cfd590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dfa8831-3d67-4382-8043-78980cfd590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978906747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:24Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ce147-dcc0-429f-9e61-ec46ae37d3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb1ce147-dcc0-429f-9e61-ec46ae37d3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c90bbe3-1a8c-4b32-bc27-5b046d9e6058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c90bbe3-1a8c-4b32-bc27-5b046d9e6058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b', 'volume_name': 'volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c7f09-666f-4309-a0a5-7fb200798c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b11c7f09-666f-4309-a0a5-7fb200798c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c54928-3aab-4038-8ee7-c8dedd29f670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Volume b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b', 'volume_size': 1} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:24 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b 1073741824" returned: 0 in 0.700s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:24 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b Sep 28 16:28:24 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (469f5a8e-b4d5-41f1-81ca-08a39df9f931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4367c31b-4996-409d-8eab-e461fc795b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4367c31b-4996-409d-8eab-e461fc795b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-812919753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e6610-bf99-45d5-b307-5c89fce8d999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:25Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a0d8b1-dbff-4fcc-be48-c2f48c160014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79a0d8b1-dbff-4fcc-be48-c2f48c160014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874ea447-141b-4cf7-a16d-ff8a8a6d6f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874ea447-141b-4cf7-a16d-ff8a8a6d6f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd08e6610-bf99-45d5-b307-5c89fce8d999', 'volume_name': 'volume-d08e6610-bf99-45d5-b307-5c89fce8d999', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e53974f-7ada-4d50-ae4e-7cdc991a4e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e53974f-7ada-4d50-ae4e-7cdc991a4e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f407d114-142c-4bfb-837f-fa9863e35c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Volume d08e6610-bf99-45d5-b307-5c89fce8d999: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d08e6610-bf99-45d5-b307-5c89fce8d999', 'volume_size': 1} Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:24 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b" returned: 0 in 0.406s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.083s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1596981756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15409f1-f910-4511-a0ba-d1fece64a8b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Creating volume b15409f1-f910-4511-a0ba-d1fece64a8b6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:25 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2bfafe7-c8d1-4bde-a02f-4aed5dc1a80f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b78a9b7-80e9-446a-8166-d5e9a871164c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Volume volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b (0aa3c795-04bc-4bff-a1c6-b06c747e564b): created successfully Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b78a9b7-80e9-446a-8166-d5e9a871164c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (51b76947-1690-4ee7-a3b0-5710e0b5d759) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0f899712-9b49-4e59-84a5-c5b46e87cbd0 tempest-CreateVolumesFromImageTest-569999637 None] Created volume successfully. Sep 28 16:28:25 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 1073741824 Sep 28 16:28:25 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (96521d6c-0051-4deb-b912-823ae3b78519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de20f12-e262-4761-8634-74c11cb29f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de20f12-e262-4761-8634-74c11cb29f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426579291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04efb89b-0eab-4ff2-bd92-ef90a1b58b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:25Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9995bfb1-f94a-4526-9d76-8fdd986fc9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9995bfb1-f94a-4526-9d76-8fdd986fc9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4801e5af-b97e-4af4-a51b-a2478c3d7289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4801e5af-b97e-4af4-a51b-a2478c3d7289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04efb89b-0eab-4ff2-bd92-ef90a1b58b69', 'volume_name': 'volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697eb36c-e56f-4e7c-a6ff-e1041591f051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697eb36c-e56f-4e7c-a6ff-e1041591f051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c5bf29-8baf-4081-b22e-6603477a71b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume 04efb89b-0eab-4ff2-bd92-ef90a1b58b69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69', 'volume_size': 1} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:25 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 1073741824" returned: 0 in 0.766s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (217d26cc-f823-44e6-af8c-558fb2ae30f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7148698-9002-4abd-ac80-232b48526f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7148698-9002-4abd-ac80-232b48526f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945175610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45c22b5-669a-45bb-b0c0-7c2887fc02bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:26Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc5b8c-4898-49a3-a625-be8d4ac3c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cadc5b8c-4898-49a3-a625-be8d4ac3c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f63f40-7547-484b-8497-12203cae6657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f63f40-7547-484b-8497-12203cae6657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c45c22b5-669a-45bb-b0c0-7c2887fc02bc', 'volume_name': 'volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625a85bd-3a25-424e-ba40-3d48228ea17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (625a85bd-3a25-424e-ba40-3d48228ea17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601feba-c843-4700-919f-7c37cb53b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume c45c22b5-669a-45bb-b0c0-7c2887fc02bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc', 'volume_size': 1} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:25 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 Sep 28 16:28:25 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:26 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.837s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353758262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2a5297a-35f0-4782-b5df-2d7a16ad77c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65cb6d59fd8446ab36daee5ac5718a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:23Z,use_quota=True,user_id='584776c3d8c9489b98641ed36fcb338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Creating volume b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:26 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f4cc8b0-e3db-4974-81c3-af92526b3829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15409f1-f910-4511-a0ba-d1fece64a8b6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda7fe71-d0c7-4000-907c-d5a30e243301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 1073741824 Sep 28 16:28:26 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Volume volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 (b15409f1-f910-4511-a0ba-d1fece64a8b6): created successfully Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fda7fe71-d0c7-4000-907c-d5a30e243301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (93e04896-a8bb-4909-9e86-3b762ec4cbf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (1aa2060a-f5e0-41f0-9c74-20c08a349745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc0979e-f619-4a3c-9f5a-0b9569095657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9cd1dd20-f490-4b1f-ae20-caff13e6ef87 tempest-CreateVolumesFromImageTest-569999637 None] Created volume successfully. Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc0979e-f619-4a3c-9f5a-0b9569095657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292318316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db8eb6b-a2b5-474d-b8c7-539a87c533db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:26Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2201f9e3-2250-43cc-85d1-94c383851279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2201f9e3-2250-43cc-85d1-94c383851279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f46003-3ac6-47ea-81a5-60beeee3d4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f46003-3ac6-47ea-81a5-60beeee3d4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0db8eb6b-a2b5-474d-b8c7-539a87c533db', 'volume_name': 'volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9227518a-0cef-4db9-9311-d3d41a16b9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9227518a-0cef-4db9-9311-d3d41a16b9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49aa3b-dc1a-4bf4-8c1b-4969be9a7d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume 0db8eb6b-a2b5-474d-b8c7-539a87c533db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db', 'volume_size': 1} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:26 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (742504c3-8ca4-4973-8e39-2ee87b417554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94de45-75d4-4186-87fb-1a6a30143d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 1073741824" returned: 0 in 0.691s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c94de45-75d4-4186-87fb-1a6a30143d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082341893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188c843-31af-4d7f-9832-bdb7005c76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:27Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8770b95a-feb2-4113-844a-68b444a0fb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8770b95a-feb2-4113-844a-68b444a0fb9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288e59e2-ec13-4af8-b584-faff78c55765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (288e59e2-ec13-4af8-b584-faff78c55765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c188c843-31af-4d7f-9832-bdb7005c76e4', 'volume_name': 'volume-c188c843-31af-4d7f-9832-bdb7005c76e4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484a5c89-5881-459d-a749-5d82f8416370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484a5c89-5881-459d-a749-5d82f8416370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc55ede0-6600-4d4f-8944-e0c7c1fd3ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:26 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume c188c843-31af-4d7f-9832-bdb7005c76e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c188c843-31af-4d7f-9832-bdb7005c76e4', 'volume_size': 1} Sep 28 16:28:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:27 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:27 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:27 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (cae7049e-f1a9-443b-8366-479410e07210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d42fea8-e5b1-446c-8e8d-b090a5f79d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.655s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1810807605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79ce31d1-e6ba-456c-9264-957d99f81e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:24Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Creating volume 79ce31d1-e6ba-456c-9264-957d99f81e8d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:27 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d42fea8-e5b1-446c-8e8d-b090a5f79d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1452480594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3213e276-a836-44aa-a486-bfe3de5f9fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:27Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d 1073741824 Sep 28 16:28:27 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee0beb2-7d74-448f-92d3-e9e9913422f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee0beb2-7d74-448f-92d3-e9e9913422f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0becbb78-8dbf-4df3-a679-a30527c78d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0becbb78-8dbf-4df3-a679-a30527c78d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3213e276-a836-44aa-a486-bfe3de5f9fe4', 'volume_name': 'volume-3213e276-a836-44aa-a486-bfe3de5f9fe4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958d5b9-fe9c-4fc9-bb0e-1f828c012d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3958d5b9-fe9c-4fc9-bb0e-1f828c012d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e1f808-7003-4acb-adbe-6c50131283ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume 3213e276-a836-44aa-a486-bfe3de5f9fe4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3213e276-a836-44aa-a486-bfe3de5f9fe4', 'volume_size': 1} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e72546d1-c535-4e38-8a8f-7bfb782c0922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1683f927-2eaa-4dfb-886e-8ea4b242a108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Volume volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 (b2a5297a-35f0-4782-b5df-2d7a16ad77c6): created successfully Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1683f927-2eaa-4dfb-886e-8ea4b242a108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Flow 'volume_create_manager' (e5edd675-41bc-45f8-8a13-a94b2fdd6860) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a3628e0a-1feb-415a-b7af-a5988c62852b tempest-VolumeDependencyTests-227290881 None] Created volume successfully. Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Flow 'volume_create_manager' (6bf173fd-1a0b-4b3a-b0ce-00d488c1d2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d2dae-acfc-403a-8a68-95770327a44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d1d2dae-acfc-403a-8a68-95770327a44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b228922b-2418-4dcc-a60b-103b9588f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e034910489b40b4b45220fdfc4a36d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:28Z,use_quota=True,user_id='7c6cc6e78c244e7fa44eadd3461bd9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61890ebe-4c85-421e-8972-75eb69418ce4),volume_type_id=61890ebe-4c85-421e-8972-75eb69418ce4)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479ad54d-9666-41e7-af9a-d565ad3f5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (479ad54d-9666-41e7-af9a-d565ad3f5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158ca0ca-c4b1-45c5-8659-a54cbb1bbd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:28:27 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d 1073741824" returned: 0 in 0.496s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (158ca0ca-c4b1-45c5-8659-a54cbb1bbd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b228922b-2418-4dcc-a60b-103b9588f811', 'volume_name': 'volume-b228922b-2418-4dcc-a60b-103b9588f811', 'volume_size': 1, 'image_id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '300bbc2c0f56a0ff0c30ef94e4bff12c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e034910489b40b4b45220fdfc4a36d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f25a940802dcc8704b82914474dee05005f9cee9ffb51d47b4d0a4ed6eb7ed10b00b40c789d1f0f1b4b11748e5c94e76cf65927a977854b557d5db0aa9e06e4', 'id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abbd7f38-1113-4937-a2fe-6618ce2e4614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf152006-30e1-450a-858e-a258bdf5d8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf152006-30e1-450a-858e-a258bdf5d8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dee7b8-9406-45eb-a33a-398e52c450ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:27 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Volume b228922b-2418-4dcc-a60b-103b9588f811: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b228922b-2418-4dcc-a60b-103b9588f811', 'volume_size': 1, 'image_id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '300bbc2c0f56a0ff0c30ef94e4bff12c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e034910489b40b4b45220fdfc4a36d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f25a940802dcc8704b82914474dee05005f9cee9ffb51d47b4d0a4ed6eb7ed10b00b40c789d1f0f1b4b11748e5c94e76cf65927a977854b557d5db0aa9e06e4', 'id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abbd7f38-1113-4937-a2fe-6618ce2e4614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 28 16:28:27 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Trying to clone b228922b-2418-4dcc-a60b-103b9588f811 from image abbd7f38-1113-4937-a2fe-6618ce2e4614 at location (None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:28 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d Sep 28 16:28:28 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:28:28 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b57d4f9-af81-4667-92fc-78b0688c0b35]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:28 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:28 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:28 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.047s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-978906747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:24Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Creating volume b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:28 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7b7560c-9f76-40a9-ad69-da8392da582a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79ce31d1-e6ba-456c-9264-957d99f81e8d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc1a71-9db8-4023-8fc5-317997b55ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:28 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b 1073741824 Sep 28 16:28:28 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:28 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Volume volume-79ce31d1-e6ba-456c-9264-957d99f81e8d (79ce31d1-e6ba-456c-9264-957d99f81e8d): created successfully Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bc1a71-9db8-4023-8fc5-317997b55ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (2359c065-2a5b-4015-a191-adc03d9dbfea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-42f51d55-a163-4a4a-bbc6-d4102cbb59ec tempest-CreateVolumesFromImageTest-569999637 None] Created volume successfully. Sep 28 16:28:28 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:28 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:28 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:28 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b 1073741824" returned: 0 in 0.558s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:28 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b Sep 28 16:28:28 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:28 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 1 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:28 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Temporary image abbd7f38-1113-4937-a2fe-6618ce2e4614 is fetched for user 7c6cc6e78c244e7fa44eadd3461bd9de. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eda183-6698-44f8-9ccf-673f2eaedf7d]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:29 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.323s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-812919753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d08e6610-bf99-45d5-b307-5c89fce8d999,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3e9d94c3dd3463dae347b3e4ccbf8ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:25Z,use_quota=True,user_id='cf02d73789b9437c98f4ec1a0d7ee774',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Creating volume d08e6610-bf99-45d5-b307-5c89fce8d999 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:29 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:29 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92c54928-3aab-4038-8ee7-c8dedd29f670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:29 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 1073741824 Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec5739-93d2-4f5a-ae3f-a0c0d5aa1743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:29 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Volume volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b (b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b): created successfully Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ec5739-93d2-4f5a-ae3f-a0c0d5aa1743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (9433e4c2-4946-45f1-b2c3-7986ac84a4eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-305987ef-0eac-46a6-ba98-8d0344a6ecf1 tempest-CreateVolumesFromImageTest-569999637 None] Created volume successfully. Sep 28 16:28:29 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:29 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:29 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:29 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 1073741824" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:29 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 Sep 28 16:28:29 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:29 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:30 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] <== create_volume: return (868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.689s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-426579291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04efb89b-0eab-4ff2-bd92-ef90a1b58b69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:25Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume 04efb89b-0eab-4ff2-bd92-ef90a1b58b69 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f407d114-142c-4bfb-837f-fa9863e35c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d08e6610-bf99-45d5-b307-5c89fce8d999', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:30 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 1073741824 Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39540bcf-0567-47d1-b8fb-1ab2641ed0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:30 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Volume volume-d08e6610-bf99-45d5-b307-5c89fce8d999 (d08e6610-bf99-45d5-b307-5c89fce8d999): created successfully Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39540bcf-0567-47d1-b8fb-1ab2641ed0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Flow 'volume_create_manager' (469f5a8e-b4d5-41f1-81ca-08a39df9f931) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-dea7a495-1a8d-4641-a8c7-d7fbee2665af tempest-CreateVolumesFromImageTest-569999637 None] Created volume successfully. Sep 28 16:28:30 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 1073741824" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:30 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 Sep 28 16:28:30 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-d08e6610-bf99-45d5-b307-5c89fce8d999-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-d08e6610-bf99-45d5-b307-5c89fce8d999-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:30 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" returned: 0 in 0.279s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.928s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-945175610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c45c22b5-669a-45bb-b0c0-7c2887fc02bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:26Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume c45c22b5-669a-45bb-b0c0-7c2887fc02bc {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:30 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc 1073741824 Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01c5bf29-8baf-4081-b22e-6603477a71b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:30 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e15f94-f45f-45fb-9554-7e8aacf37507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-quobyte-d08e6610-bf99-45d5-b307-5c89fce8d999" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 (04efb89b-0eab-4ff2-bd92-ef90a1b58b69): created successfully Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41e15f94-f45f-45fb-9554-7e8aacf37507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (96521d6c-0051-4deb-b912-823ae3b78519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-d08e6610-bf99-45d5-b307-5c89fce8d999" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f7d91d8c-51d0-449a-9809-8432ade69ad7 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d170f-2538-4b01-9f8d-2906cc98f4de]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:31 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 Sep 28 16:28:31 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:31 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc 1073741824" returned: 0 in 0.451s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:31 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:31 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc Sep 28 16:28:31 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999 Sep 28 16:28:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:31 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.099s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-292318316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0db8eb6b-a2b5-474d-b8c7-539a87c533db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:26Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume 0db8eb6b-a2b5-474d-b8c7-539a87c533db {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:31 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:31 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db 1073741824 Sep 28 16:28:31 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1601feba-c843-4700-919f-7c37cb53b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14220c6-abe0-4a56-8974-f5125a050286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d08e6610-bf99-45d5-b307-5c89fce8d999" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-d08e6610-bf99-45d5-b307-5c89fce8d999" released by "delete_volume" :: held 0.758s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc (c45c22b5-669a-45bb-b0c0-7c2887fc02bc): created successfully Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d14220c6-abe0-4a56-8974-f5125a050286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (217d26cc-f823-44e6-af8c-558fb2ae30f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-49d7ef0f-9a60-49d9-9f16-de04cdba7089 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Created reservations ['d198c865-d4eb-4dcb-a42f-ecf9687f768a', '4a47ff5b-05c7-4158-b70a-7e6827b41778', '087c17b4-bf75-4a2e-8ede-c70c1588826c', 'f34001b9-f57b-4b7e-9ca1-3ec8a7194d72'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:31 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:31 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-quobyte-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[641589b5-76d0-45ec-bcf8-9f8a807556a7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:32 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Deleted volume successfully. Sep 28 16:28:32 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db 1073741824" returned: 0 in 0.555s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-e98e1bb4-e75a-46a1-a71e-de62ccab245b tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-d08e6610-bf99-45d5-b307-5c89fce8d999-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:32 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db Sep 28 16:28:32 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b Sep 28 16:28:32 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:32 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:32 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.483s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2082341893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c188c843-31af-4d7f-9832-bdb7005c76e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:27Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume c188c843-31af-4d7f-9832-bdb7005c76e4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:32 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:32 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed49aa3b-dc1a-4bf4-8c1b-4969be9a7d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:32 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 1073741824 Sep 28 16:28:32 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f25acb3-5634-4424-9f0d-9289ccb98b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db (0db8eb6b-a2b5-474d-b8c7-539a87c533db): created successfully Sep 28 16:28:32 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b Sep 28 16:28:32 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f25acb3-5634-4424-9f0d-9289ccb98b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (1aa2060a-f5e0-41f0-9c74-20c08a349745) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f0f28bda-074c-4b83-9d82-1ee6f214a142 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:32 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b" released by "delete_volume" :: held 0.744s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Created reservations ['29864a2e-caa9-46f8-83ba-216cfa69c722', '802548b3-0ee6-42ca-a9d7-83555feda5bf', '9d0098bf-daa9-4a75-a528-6772d777ef20', '9adb9248-8e5c-4de5-9e3f-3b677cc8627d'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:32 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:32 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:32 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 1073741824" returned: 0 in 0.512s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:33 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 Sep 28 16:28:33 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-79ce31d1-e6ba-456c-9264-957d99f81e8d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-79ce31d1-e6ba-456c-9264-957d99f81e8d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:33 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Deleted volume successfully. Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-quobyte-79ce31d1-e6ba-456c-9264-957d99f81e8d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-88fd2f21-85e6-4932-b8cf-4910e96440e0 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-b334230d-9d2a-4ee3-8c7d-c71e6f63ef1b-delete_volume" released by "delete_volume" :: held 1.288s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-79ce31d1-e6ba-456c-9264-957d99f81e8d" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a794d-8cda-48ce-adc4-c12e9cfecbfa]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:33 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4" returned: 0 in 0.316s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.856s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1452480594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3213e276-a836-44aa-a486-bfe3de5f9fe4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f202ab608f64b79babec9057a4594a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:27Z,use_quota=True,user_id='ce62a02498904feabebfe105a7f771a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Creating volume 3213e276-a836-44aa-a486-bfe3de5f9fe4 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:33 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc55ede0-6600-4d4f-8944-e0c7c1fd3ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c188c843-31af-4d7f-9832-bdb7005c76e4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:33 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 1073741824 Sep 28 16:28:33 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171446c6-a24e-463d-8293-d215a1be57b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:33 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-c188c843-31af-4d7f-9832-bdb7005c76e4 (c188c843-31af-4d7f-9832-bdb7005c76e4): created successfully Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (171446c6-a24e-463d-8293-d215a1be57b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (742504c3-8ca4-4973-8e39-2ee87b417554) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:33 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d Sep 28 16:28:33 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fae4f4e6-6825-4121-b893-098ad87eabb1 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:33 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:33 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d Sep 28 16:28:33 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:33 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 1073741824" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:33 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 Sep 28 16:28:33 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:34 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-79ce31d1-e6ba-456c-9264-957d99f81e8d" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-79ce31d1-e6ba-456c-9264-957d99f81e8d" released by "delete_volume" :: held 0.726s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Created reservations ['bdb86ee9-5962-4ab0-a7b9-80d5b54137b8', '5d064f66-fd9f-408d-a453-831146dc9b66', '6966dd35-40cb-4789-ae50-f5fc85c1ba95', 'c3b641bf-21b8-4493-84cb-4a157d9407a3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:34 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.266s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:34 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:34 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e1f808-7003-4acb-adbe-6c50131283ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3213e276-a836-44aa-a486-bfe3de5f9fe4', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86633dd-1fdf-49bd-9d4c-9c5594b81992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Creating offline snapshot d9b1ccad-fdd0-432b-bd53-93374bb28122 of volume b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:28:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Volume volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 (3213e276-a836-44aa-a486-bfe3de5f9fe4): created successfully Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86633dd-1fdf-49bd-9d4c-9c5594b81992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Flow 'volume_create_manager' (cae7049e-f1a9-443b-8366-479410e07210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d1e61-2463-4332-b6b2-b6e950969cb3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8d43c492-73db-4bdc-a967-f448a47ab9cf tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created volume successfully. Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-b15409f1-f910-4511-a0ba-d1fece64a8b6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:34 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-b15409f1-f910-4511-a0ba-d1fece64a8b6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-quobyte-b15409f1-f910-4511-a0ba-d1fece64a8b6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:34 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Deleted volume successfully. Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-b15409f1-f910-4511-a0ba-d1fece64a8b6" acquired by "delete_volume" :: waited 0.039s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a41a4-9d91-4718-ad50-cf2b87a2b600]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7d9ffece-fca3-4320-a51f-29a782ec4432 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-79ce31d1-e6ba-456c-9264-957d99f81e8d-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:34 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 Sep 28 16:28:34 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:34 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:34 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 1G Sep 28 16:28:34 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:34 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6" returned: 0 in 0.429s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6 Sep 28 16:28:35 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-3213e276-a836-44aa-a486-bfe3de5f9fe4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-3213e276-a836-44aa-a486-bfe3de5f9fe4-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-3213e276-a836-44aa-a486-bfe3de5f9fe4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-3213e276-a836-44aa-a486-bfe3de5f9fe4" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f3e5d-742f-4f20-9e2a-d900c93fab43]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b15409f1-f910-4511-a0ba-d1fece64a8b6" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:35 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 1G" returned: 0 in 0.543s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-b15409f1-f910-4511-a0ba-d1fece64a8b6" released by "delete_volume" :: held 0.816s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:35 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:35 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 Sep 28 16:28:35 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Created reservations ['08f4f66f-4178-4cad-a2fb-934d8e90907c', 'dc318225-7718-4779-8da3-3db6048e5a3b', '99f099a4-0dda-4f04-979f-1af1a3bf4408', 'e39eb305-d1b1-493e-a959-0edf347d4366'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:35 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-0aa3c795-04bc-4bff-a1c6-b06c747e564b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-0aa3c795-04bc-4bff-a1c6-b06c747e564b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:35 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4" returned: 0 in 0.430s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 is being set with open permissions: ugo+rw Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4 Sep 28 16:28:35 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:35 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "cinder-quobyte-0aa3c795-04bc-4bff-a1c6-b06c747e564b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-0aa3c795-04bc-4bff-a1c6-b06c747e564b" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28e673d-335c-44bf-9a48-b79bd2cd231d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:35 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Deleted volume successfully. Sep 28 16:28:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f02a3dbb-4a7e-446e-b840-d8768ee828a8 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-b15409f1-f910-4511-a0ba-d1fece64a8b6-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:35 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b Sep 28 16:28:35 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.288s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-3213e276-a836-44aa-a486-bfe3de5f9fe4" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-3213e276-a836-44aa-a486-bfe3de5f9fe4" released by "delete_volume" :: held 0.804s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info Sep 28 16:28:36 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['a326249d-eb3b-48d6-b32c-6e39c8315df9', 'c8c485cb-24ab-48a6-89c2-eaa6df12ab29', 'eddbcb2d-e401-4b11-baae-4cb23c4a5bae', 'b4e2bbb5-0793-4f42-b845-8d7684ad2bab'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:36 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b" returned: 0 in 0.452s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b Sep 28 16:28:36 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-c188c843-31af-4d7f-9832-bdb7005c76e4-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-c188c843-31af-4d7f-9832-bdb7005c76e4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-c188c843-31af-4d7f-9832-bdb7005c76e4" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:36 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info is being set with open permissions: ugo+rw Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-c188c843-31af-4d7f-9832-bdb7005c76e4" acquired by "delete_volume" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:36 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info Sep 28 16:28:36 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a3e825-4bc6-4ae9-9be1-ceb3aa3f43e8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:36 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.340s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ba634439-8e18-4a24-8e24-1017d5a2ab65 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-3213e276-a836-44aa-a486-bfe3de5f9fe4-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:36 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 Sep 28 16:28:36 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0aa3c795-04bc-4bff-a1c6-b06c747e564b" returned: 0 in 0.416s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-quobyte-0aa3c795-04bc-4bff-a1c6-b06c747e564b" released by "delete_volume" :: held 0.930s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:36 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.info" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.613s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.966s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b228922b-2418-4dcc-a60b-103b9588f811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e034910489b40b4b45220fdfc4a36d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:28Z,use_quota=True,user_id='7c6cc6e78c244e7fa44eadd3461bd9de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61890ebe-4c85-421e-8972-75eb69418ce4),volume_type_id=61890ebe-4c85-421e-8972-75eb69418ce4)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Creating volume b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:36 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:36 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1073741824 Sep 28 16:28:36 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1bcbf0ed-76d1-46d2-99e5-b34862e22882 tempest-VolumeDependencyTests-227290881 None] Create snapshot completed successfully Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Created reservations ['937a4acc-8019-4b1f-9737-638eaaac8d25', 'd12ebe5e-c541-46d8-b7e2-99f17de0889c', 'f5c4bf9a-f0e1-4869-bc81-168e9db25f0e', '3d4237c0-b173-4f7b-82be-787ca80db98b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:36 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.435s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:28:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4" returned: 0 in 0.492s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:37 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:37 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4 Sep 28 16:28:37 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:37 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c188c843-31af-4d7f-9832-bdb7005c76e4" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Deleted volume successfully. Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-c188c843-31af-4d7f-9832-bdb7005c76e4" released by "delete_volume" :: held 0.897s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-39c99af5-31d2-4abf-87f9-450af09c22c7 tempest-CreateVolumesFromImageTest-569999637 None] Lock "cinder-0aa3c795-04bc-4bff-a1c6-b06c747e564b-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['9e04f324-76bd-4921-b54d-0bbee0c2bdf8', '86b2c6b1-df82-4c5b-881a-6e77dba9c75e', 'f5de2807-ad0c-4ba4-ab07-abf3f064dca1', '8fbfbba1-6763-4050-8765-4bbbd8df4237'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:37 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1073741824" returned: 0 in 0.602s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 Sep 28 16:28:37 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-0db8eb6b-a2b5-474d-b8c7-539a87c533db-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:37 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:37 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-0db8eb6b-a2b5-474d-b8c7-539a87c533db-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-0db8eb6b-a2b5-474d-b8c7-539a87c533db" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-0db8eb6b-a2b5-474d-b8c7-539a87c533db" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbe423f-010f-43f6-943e-d83df050d4bc]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Attempting download of abbd7f38-1113-4937-a2fe-6618ce2e4614 ((None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}])) to volume b228922b-2418-4dcc-a60b-103b9588f811. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:28:37 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76777286-4670-4339-a21f-16d60d097f12]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:38 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db Sep 28 16:28:38 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-21969411-381a-4b93-93c3-66c6b1fb9272 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-c188c843-31af-4d7f-9832-bdb7005c76e4-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:38 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv Sep 28 16:28:38 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Flow 'volume_create_manager' (79c05c7f-71e9-4f3f-882e-a3737390390a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eaeeef-212a-4ae1-9ac3-3ed5587bf4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36eaeeef-212a-4ae1-9ac3-3ed5587bf4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1050055643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a65cb6d59fd8446ab36daee5ac5718a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9b1ccad-fdd0-432b-bd53-93374bb28122,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:38Z,use_quota=True,user_id='584776c3d8c9489b98641ed36fcb338e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6789d89-7774-4616-98c7-e29799fd28a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6789d89-7774-4616-98c7-e29799fd28a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50653f7e-6341-4efb-8fc2-35e7f708649a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50653f7e-6341-4efb-8fc2-35e7f708649a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf', 'volume_name': 'volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf', 'volume_size': 1, 'snapshot_id': 'd9b1ccad-fdd0-432b-bd53-93374bb28122'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f703c7d-dad7-4951-b434-34549739affb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f703c7d-dad7-4951-b434-34549739affb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b5b43-9ff4-4d15-86fd-bb292c24f549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Volume b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf', 'volume_size': 1, 'snapshot_id': 'd9b1ccad-fdd0-432b-bd53-93374bb28122'} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Creating volume b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf from snapshot d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:38 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv" returned: 0 in 0.458s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:38 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] snapshot: d9b1ccad-fdd0-432b-bd53-93374bb28122, volume: b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db" returned: 0 in 0.667s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:38 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db Sep 28 16:28:38 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc667809-6ba7-47c8-9158-c50a95315db0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:38 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv Sep 28 16:28:38 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:38 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:38 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:38 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-0db8eb6b-a2b5-474d-b8c7-539a87c533db" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:38 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-0db8eb6b-a2b5-474d-b8c7-539a87c533db" released by "delete_volume" :: held 1.091s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv" returned: 1 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_abbd7f38-1113-4937-a2fe-6618ce2e4614_9s69wopv' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[056ea0e5-be25-463b-99ab-aa7f936b3a6c]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['31244951-9619-483f-a4c8-beeeee6d423d', '728bcb8c-a84f-4ff7-a60e-c72de9511830', 'c8e2e3de-4f99-466e-bfa0-4897d01bdd1b', '0c65010e-a3ec-4067-abde-6a706e311727'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:39 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.472s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:28:39 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:39 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358fabe-81d6-45de-9fd6-7dd002e458f4]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:39 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:39 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:39 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:39 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:39 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD Sep 28 16:28:39 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-9971e366-7e4b-498e-803c-07fec02fa634 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-0db8eb6b-a2b5-474d-b8c7-539a87c533db-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:39 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:39 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf Sep 28 16:28:39 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] abbd7f38-1113-4937-a2fe-6618ce2e4614 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:39 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 Sep 28 16:28:39 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-c45c22b5-669a-45bb-b0c0-7c2887fc02bc-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-c45c22b5-669a-45bb-b0c0-7c2887fc02bc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3197f3-2449-49f3-8bae-df174cb5f42f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:40 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc Sep 28 16:28:40 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:40 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811" returned: 0 in 0.992s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_abbd7f38-1113-4937-a2fe-6618ce2e4614_rf6h6g26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:28:40 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:40 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1G Sep 28 16:28:40 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:40 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" returned: 0 in 0.830s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:41 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc Sep 28 16:28:41 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:41 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 1G" returned: 0 in 0.678s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Downloaded image abbd7f38-1113-4937-a2fe-6618ce2e4614 ((None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}])) to volume b228922b-2418-4dcc-a60b-103b9588f811 successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Temporary image abbd7f38-1113-4937-a2fe-6618ce2e4614 for user 7c6cc6e78c244e7fa44eadd3461bd9de is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Marking volume b228922b-2418-4dcc-a60b-103b9588f811 as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:28:41 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" returned: 0 in 0.572s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-c45c22b5-669a-45bb-b0c0-7c2887fc02bc" released by "delete_volume" :: held 1.479s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Copying metadata from image abbd7f38-1113-4937-a2fe-6618ce2e4614 to b228922b-2418-4dcc-a60b-103b9588f811. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Creating volume glance metadata for volume b228922b-2418-4dcc-a60b-103b9588f811 backed by image abbd7f38-1113-4937-a2fe-6618ce2e4614 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '300bbc2c0f56a0ff0c30ef94e4bff12c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['d1dffaaa-f1e0-45f3-8e5c-4a0d5f5f3dc9', '6b784ec8-4fe1-4688-a77c-d778da41eed7', '1298ab25-5415-439d-a2c6-c2d1f1e0572e', 'd0d99daa-8bb2-4898-a1d9-ea7958dbf86c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dee7b8-9406-45eb-a33a-398e52c450ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b228922b-2418-4dcc-a60b-103b9588f811', 'volume_size': 1, 'image_id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/abbd7f38-1113-4937-a2fe-6618ce2e4614', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '300bbc2c0f56a0ff0c30ef94e4bff12c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e034910489b40b4b45220fdfc4a36d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2f25a940802dcc8704b82914474dee05005f9cee9ffb51d47b4d0a4ed6eb7ed10b00b40c789d1f0f1b4b11748e5c94e76cf65927a977854b557d5db0aa9e06e4', 'id': 'abbd7f38-1113-4937-a2fe-6618ce2e4614', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/abbd7f38-1113-4937-a2fe-6618ce2e4614/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e436ba9-67bc-4e2e-b469-654b289386ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:42 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:42 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:42 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Volume volume-b228922b-2418-4dcc-a60b-103b9588f811 (b228922b-2418-4dcc-a60b-103b9588f811): created successfully Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e436ba9-67bc-4e2e-b469-654b289386ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Flow 'volume_create_manager' (6bf173fd-1a0b-4b3a-b0ce-00d488c1d2a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-523c76c0-c4af-410f-8f94-cad6cdfc2978 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Created volume successfully. Sep 28 16:28:42 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-13f36817-337e-4c3c-b5ed-e3f2e482392d tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-c45c22b5-669a-45bb-b0c0-7c2887fc02bc-delete_volume" released by "delete_volume" :: held 2.454s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-04efb89b-0eab-4ff2-bd92-ef90a1b58b69-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-04efb89b-0eab-4ff2-bd92-ef90a1b58b69-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" acquired by "delete_volume" :: waited 0.051s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bbca7d-91a2-4754-a396-1e366b6deca8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Acquiring lock "cinder-b228922b-2418-4dcc-a60b-103b9588f811-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "cinder-b228922b-2418-4dcc-a60b-103b9588f811-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Acquiring lock "cinder-quobyte-b228922b-2418-4dcc-a60b-103b9588f811" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:43 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 Sep 28 16:28:43 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "cinder-quobyte-b228922b-2418-4dcc-a60b-103b9588f811" acquired by "delete_volume" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7e0807-171a-44c9-9ae7-72e861631804]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:43 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 Sep 28 16:28:43 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:43 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" returned: 0 in 0.977s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:43 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69 Sep 28 16:28:43 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:43 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811" returned: 0 in 0.806s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:44 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811 Sep 28 16:28:44 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:44 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" returned: 0 in 0.574s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-04efb89b-0eab-4ff2-bd92-ef90a1b58b69" released by "delete_volume" :: held 1.691s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['7c171768-182c-4ca8-892b-739549b71234', '4e7cfc92-ba6c-49d4-9d3c-f908f5c84bbe', '11b9c4e5-190b-4744-a17d-b76ccb8899da', '98963c51-9f47-4c15-88ee-fd1e71cb2468'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:44 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b228922b-2418-4dcc-a60b-103b9588f811" returned: 0 in 0.643s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "cinder-quobyte-b228922b-2418-4dcc-a60b-103b9588f811" released by "delete_volume" :: held 1.551s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Created reservations ['b334768d-53c6-4717-9dd4-f3f738998cfc', 'b66f4862-a40d-4185-8770-23a9adb1442c', 'b133a46c-bf9c-471f-a199-ab2fad17b383', '8afe2b0b-20e9-4db6-93d5-1cb0f1ccd506'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:45 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:45 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-421b9bfd-90cb-477c-8437-246cbedc20c5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-421b9bfd-90cb-477c-8437-246cbedc20c5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:45 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:45 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "cinder-quobyte-421b9bfd-90cb-477c-8437-246cbedc20c5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-421b9bfd-90cb-477c-8437-246cbedc20c5" acquired by "delete_volume" :: waited 0.041s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15a6ae5-642d-420f-a818-4f58273d766e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:45 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.640s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:45 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:45 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:46 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.494s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Deleted volume successfully. Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-56787673-c99b-495a-8888-186d3e78d7b9 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-04efb89b-0eab-4ff2-bd92-ef90a1b58b69-delete_volume" released by "delete_volume" :: held 3.580s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:46 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 Sep 28 16:28:46 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b07d65a6-445b-42e4-ba92-6750be6f3668 tempest-VolumeAndVolumeTypeFromImageTest-1532046249 None] Lock "cinder-b228922b-2418-4dcc-a60b-103b9588f811-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:46 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5" returned: 0 in 0.876s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:46 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5 Sep 28 16:28:46 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:47 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-421b9bfd-90cb-477c-8437-246cbedc20c5" returned: 0 in 0.483s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-quobyte-421b9bfd-90cb-477c-8437-246cbedc20c5" released by "delete_volume" :: held 1.489s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Created reservations ['a71c8ca0-c92a-48a7-a055-fe98247facc7', '1c7bb2a7-bc81-487b-9965-697a5e021bbd', '03409cca-1ab9-4d72-9e99-71b971e6e6be', '4e73e4c6-2212-45ca-a890-418ef69ff80a'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:48 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" returned: 0 in 8.506s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:48 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:28:48 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Converted 1024.00 MB image at 120.36 MB/s Sep 28 16:28:48 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf is being set with open permissions: ugo+rw Sep 28 16:28:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:48 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf Sep 28 16:28:48 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:48 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" released by "_copy_volume_from_snapshot" :: held 9.860s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" released by "_create_volume_from_snapshot" :: held 13.027s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.051s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (309b5b43-9ff4-4d15-86fd-bb292c24f549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf', 'volume_size': 1, 'snapshot_id': 'd9b1ccad-fdd0-432b-bd53-93374bb28122'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19491f69-d563-495d-9deb-850272819e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Volume volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf (b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf): created successfully Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19491f69-d563-495d-9deb-850272819e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Flow 'volume_create_manager' (79c05c7f-71e9-4f3f-882e-a3737390390a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1384bf42-a50c-40bb-92cf-a1c9fb1fb522 tempest-VolumeDependencyTests-227290881 None] Created volume successfully. Sep 28 16:28:51 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:51 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Flow 'volume_create_manager' (0d4c0c55-57ab-4d88-aa06-d71887b86fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7603f1d1-7ebf-43e9-8209-561a11533113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:51 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.363s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7603f1d1-7ebf-43e9-8209-561a11533113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5121ecc371e64cdeac0931cf8ad896b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:52Z,use_quota=True,user_id='bf421a6d7af74313bc2d10132aeae2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cbad3e-9589-4ab8-a7f2-ed7a72b8bca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44cbad3e-9589-4ab8-a7f2-ed7a72b8bca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd2c9f9-9aef-4bfb-908b-c659da3186c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.image.glance [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Creating Keystone auth plugin from conf {{(pid=87150) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 28 16:28:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Deleted volume successfully. Sep 28 16:28:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6dfb6a6f-bc6c-49e1-a354-bf2514ba6092 tempest-CreateVolumesFromSourceVolumeTest-1738465989 None] Lock "cinder-421b9bfd-90cb-477c-8437-246cbedc20c5-delete_volume" released by "delete_volume" :: held 6.583s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd2c9f9-9aef-4bfb-908b-c659da3186c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a', 'volume_name': 'volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a', 'volume_size': 1, 'image_id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68075db2643e7aa27a5a4b4e01e92a2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5121ecc371e64cdeac0931cf8ad896b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc8f88c70879c6ef936c25a79242c8b92051969fa035f21711edfefbeb4c28466bd7c0a573ae4f7ab2ca6004a3bd7f4b78fb102772b51be4e31e8b20da40d3c4', 'id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9687f50-7f07-4e2a-b1c9-bcc12f472c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9687f50-7f07-4e2a-b1c9-bcc12f472c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e1e56a-1ed2-45e6-bd59-3d8827fecca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:52 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a', 'volume_size': 1, 'image_id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68075db2643e7aa27a5a4b4e01e92a2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5121ecc371e64cdeac0931cf8ad896b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc8f88c70879c6ef936c25a79242c8b92051969fa035f21711edfefbeb4c28466bd7c0a573ae4f7ab2ca6004a3bd7f4b78fb102772b51be4e31e8b20da40d3c4', 'id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04/file', 'properties': {}}, 'image_service': } Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Trying to clone f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a from image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 at location (None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}]). {{(pid=87150) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 28 16:28:52 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Image download 0.00 MB at 0.00 MB/s Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dfdbdb-7d38-4d64-94b6-8aafb651e0d8]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-d9b1ccad-fdd0-432b-bd53-93374bb28122-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-d9b1ccad-fdd0-432b-bd53-93374bb28122-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Deleting offline snapshot d9b1ccad-fdd0-432b-bd53-93374bb28122 of volume b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] snapshot_file for this snap is: volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:28:52 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:52 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e087d2ca-df2f-4b78-9420-5af66d09bb9f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:52 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:52 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:52 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:53 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:53 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:53 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a600c187-746e-4be9-b878-171af7a0b668]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:53 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 1 in 0.426s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Temporary image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 is fetched for user bf421a6d7af74313bc2d10132aeae2e1. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 28 16:28:53 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:53 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d172d6d0-49ea-4d11-9d1b-35f0871e7a4b]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:53 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:53 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:53 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 0 in 0.477s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:53 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.719s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:54 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:54 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:54 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:54 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:54 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 1 in 0.456s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5121ecc371e64cdeac0931cf8ad896b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:52Z,use_quota=True,user_id='bf421a6d7af74313bc2d10132aeae2e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Creating volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:54 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:54 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1073741824 Sep 28 16:28:54 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:54 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122 Sep 28 16:28:54 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:54 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6.d9b1ccad-fdd0-432b-bd53-93374bb28122" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-d9b1ccad-fdd0-432b-bd53-93374bb28122" released by "_delete_snapshot" :: held 2.249s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:54 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" released by "delete_snapshot" :: held 2.276s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Created reservations ['2a405aff-c1fc-4c20-9e37-49944378bf30', 'eaaa38dc-d031-4214-a8d4-ab12374434be', '93013d10-aea1-47b5-9798-9abb3fc615c3', '4d377aa3-2bea-4627-94a4-30b288bbbace'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:55 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1073741824" returned: 0 in 0.616s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:55 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Delete snapshot completed successfully. Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df30e292-1165-42fc-9fff-52bf937f3b37 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-d9b1ccad-fdd0-432b-bd53-93374bb28122-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:55 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a Sep 28 16:28:55 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:55 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" returned: 0 in 0.295s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Attempting download of 33e9f119-98e1-4eb4-b2f1-919dd378fd04 ((None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}])) to volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e291fb-1907-4318-806b-a989a45cc9f9]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:55 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita Sep 28 16:28:55 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-b2a5297a-35f0-4782-b5df-2d7a16ad77c6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "cinder-b2a5297a-35f0-4782-b5df-2d7a16ad77c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:55 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13bbaf7-8f0a-4ce0-aede-a2c0bba499d9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:55 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:56 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita Sep 28 16:28:56 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:56 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:56 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:56 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita" returned: 1 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_33e9f119-98e1-4eb4-b2f1-919dd378fd04_50yk8ita' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d1bfd8-b92f-4145-aa3e-ee689cbe8b30]: (4, 'raw') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:56 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.483s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:56 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6 Sep 28 16:28:56 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:56 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:56 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:56 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-34d844e5-8322-46bc-ac66-9df1c34c9b3f tempest-ProjectAdminTests-1493163970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.145206451416, 'free_capacity_gb': 1775.145206451416, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87150) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 28 16:28:56 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b2a5297a-35f0-4782-b5df-2d7a16ad77c6" released by "delete_volume" :: held 0.889s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:56 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD Sep 28 16:28:56 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:56 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Created reservations ['8e964e60-3645-4335-89b2-261a5f785f6e', '2f089587-a834-436d-8308-59ea2614cb86', 'b9b51831-5e1e-428b-a160-9fff6678198f', '2fd77032-cae6-4aac-8651-149bacf236c3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:57 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:57 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:57 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] 33e9f119-98e1-4eb4-b2f1-919dd378fd04 was raw, converting to qcow2 {{(pid=87150) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:57 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a Sep 28 16:28:57 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (7c962fd3-2694-4a4c-8b81-1b322607c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de66146a-c4bb-413c-a1c3-7530f680d9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de66146a-c4bb-413c-a1c3-7530f680d9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799019081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a3106c-83ec-461e-8a1f-b519751f52e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:57Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:57 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8194ab8b-be8f-4db7-8145-9adaa8330145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8194ab8b-be8f-4db7-8145-9adaa8330145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b65cc3-ef43-422e-904f-454505da325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49b65cc3-ef43-422e-904f-454505da325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a3106c-83ec-461e-8a1f-b519751f52e8', 'volume_name': 'volume-a3a3106c-83ec-461e-8a1f-b519751f52e8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f09ee9-c619-470f-b310-6e33a5e7b729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f09ee9-c619-470f-b310-6e33a5e7b729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b9fdc-6dd8-4c41-a32d-14fa8ff68806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume a3a3106c-83ec-461e-8a1f-b519751f52e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a3106c-83ec-461e-8a1f-b519751f52e8', 'volume_size': 1} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1799019081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a3106c-83ec-461e-8a1f-b519751f52e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:28:57Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:28:57 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Deleted volume successfully. Sep 28 16:28:57 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 1073741824 Sep 28 16:28:57 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6a0f0546-07fc-414c-b37d-69a7b353e8de tempest-VolumeDependencyTests-227290881 None] Lock "cinder-b2a5297a-35f0-4782-b5df-2d7a16ad77c6-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:57 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" returned: 0 in 0.637s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_33e9f119-98e1-4eb4-b2f1-919dd378fd04_42z4y6vodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:28:57 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Converted 0.00 MB image at 0.00 MB/s Sep 28 16:28:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:57 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1G Sep 28 16:28:57 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:58 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 1073741824" returned: 0 in 0.567s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:58 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 Sep 28 16:28:58 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:58 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a 1G" returned: 0 in 0.564s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Downloaded image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 ((None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}])) to volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a successfully. {{(pid=87150) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Temporary image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 for user bf421a6d7af74313bc2d10132aeae2e1 is deleted. {{(pid=87150) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.volume_utils [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Marking volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a as bootable. {{(pid=87150) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Copying metadata from image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 to f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a. {{(pid=87150) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Creating volume glance metadata for volume f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a backed by image 33e9f119-98e1-4eb4-b2f1-919dd378fd04 with: {'image_id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '68075db2643e7aa27a5a4b4e01e92a2b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87150) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f43bce-229a-4492-a0e6-74da78f061a0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:58 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8" returned: 0 in 0.369s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb1b9fdc-6dd8-4c41-a32d-14fa8ff68806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a3106c-83ec-461e-8a1f-b519751f52e8', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df0115c-aa79-4b8f-af61-8acff1c92a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 (a3a3106c-83ec-461e-8a1f-b519751f52e8): created successfully Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2df0115c-aa79-4b8f-af61-8acff1c92a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (7c962fd3-2694-4a4c-8b81-1b322607c822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a1ec9ffe-776a-4388-9c35-f2be4793a789 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:28:58 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf Sep 28 16:28:58 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e1e56a-1ed2-45e6-bd59-3d8827fecca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a', 'volume_size': 1, 'image_id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '68075db2643e7aa27a5a4b4e01e92a2b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5121ecc371e64cdeac0931cf8ad896b1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'fc8f88c70879c6ef936c25a79242c8b92051969fa035f21711edfefbeb4c28466bd7c0a573ae4f7ab2ca6004a3bd7f4b78fb102772b51be4e31e8b20da40d3c4', 'id': '33e9f119-98e1-4eb4-b2f1-919dd378fd04', 'created_at': datetime.datetime(2026, 9, 28, 14, 28, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 28, 14, 28, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/33e9f119-98e1-4eb4-b2f1-919dd378fd04/file', 'properties': {}}, 'image_service': }' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b6f6d8-9df6-4e88-a066-6b36ba10583a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:28:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Volume volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a (f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a): created successfully Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19b6f6d8-9df6-4e88-a066-6b36ba10583a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Flow 'volume_create_manager' (0d4c0c55-57ab-4d88-aa06-d71887b86fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:28:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-424297b6-a173-471e-b11b-55ee7b4eff52 tempest-VolumeImageDependencyTests-1356510398 None] Created volume successfully. Sep 28 16:28:58 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" returned: 0 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:58 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf Sep 28 16:28:58 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:59 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" returned: 0 in 0.270s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-quobyte-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf" released by "delete_volume" :: held 0.738s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Created reservations ['86e38d16-7177-49df-9d1a-883d5434d4cb', '3b134b84-2c85-4131-b93f-0fbfc058ac64', '6594c36e-44ee-4127-8bb9-9718df54e7c7', '28eae4b0-0eca-4111-a3ee-a92fc0437f01'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:59 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:28:59 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:28:59 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:28:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Deleted volume successfully. Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Acquiring lock "cinder-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "cinder-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fb8a0301-2816-4db3-9a4c-3161c82568e8 tempest-VolumeDependencyTests-227290881 None] Lock "cinder-b5b82528-6185-4bf9-b7a7-e17c9cb1b5cf-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Acquiring lock "cinder-quobyte-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "cinder-quobyte-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[835ffef5-79ef-4901-8050-4c5d52e6b72e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating offline snapshot 00afd366-1bc7-4744-9fe3-c76d3959b7da of volume a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca75e5d6-e880-408b-8b2b-16da222b161b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:28:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:00 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a Sep 28 16:29:00 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:00 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 Sep 28 16:29:00 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:00 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" returned: 0 in 0.478s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:00 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a Sep 28 16:29:00 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:00 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8" returned: 0 in 0.510s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:00 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da 1G Sep 28 16:29:00 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:00 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "cinder-quobyte-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a" released by "delete_volume" :: held 0.864s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Created reservations ['c928c59b-97ed-42e3-a05c-1950c55cbcda', '60ed19e7-3f96-4765-8109-b049d72c8eea', 'fd476c38-3448-4fac-872a-367c5d6d690e', '34c53bf3-5baa-4a49-81e0-79d3f2a77bb1'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:01 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:01 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:01 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da 1G" returned: 0 in 0.731s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:01 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da Sep 28 16:29:01 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:01 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.390s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Deleted volume successfully. Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6766a6fd-510b-4054-9f1a-3fd520db6275 tempest-VolumeImageDependencyTests-1356510398 None] Lock "cinder-f5f9a7f7-9ff0-493a-8ffb-d4a1bca1b79a-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:01 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da is being set with open permissions: ugo+rw Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:01 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da Sep 28 16:29:01 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:01 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da" returned: 0 in 0.311s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:02 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info Sep 28 16:29:02 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:02 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info" returned: 0 in 0.431s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:02 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info is being set with open permissions: ugo+rw Sep 28 16:29:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:02 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info Sep 28 16:29:02 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:02 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.info" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-55d53718-2549-48f9-8626-c15ab14f8012 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Create snapshot completed successfully Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (0e2bb1a1-a78d-478a-88d7-047dca1d0937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497c0f6e-aaa2-4f20-8ff5-d75e6b270edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (497c0f6e-aaa2-4f20-8ff5-d75e6b270edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531319734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75b4077-1335-4e4a-986b-70dfffe91ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:04Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea09d45-32b9-4f32-91d9-4b41818f39c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eea09d45-32b9-4f32-91d9-4b41818f39c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb41244-bd8c-4587-a101-466e4bf33974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdb41244-bd8c-4587-a101-466e4bf33974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b75b4077-1335-4e4a-986b-70dfffe91ec9', 'volume_name': 'volume-b75b4077-1335-4e4a-986b-70dfffe91ec9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fc3e7-4106-4c0a-942d-b6f127153aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820fc3e7-4106-4c0a-942d-b6f127153aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400a6c60-a739-4b02-a9be-de74eb1fa322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:03 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume b75b4077-1335-4e4a-986b-70dfffe91ec9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b75b4077-1335-4e4a-986b-70dfffe91ec9', 'volume_size': 1} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-531319734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b75b4077-1335-4e4a-986b-70dfffe91ec9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:04Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume b75b4077-1335-4e4a-986b-70dfffe91ec9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:03 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:03 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 1073741824 Sep 28 16:29:03 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (4fbf5592-802c-4667-b9c8-92e96c81516b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47579cf3-dc04-4354-a552-8dd94e3131f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47579cf3-dc04-4354-a552-8dd94e3131f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291298313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef0cf0-dfa1-4c22-a077-73e04b5212b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:04Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb81a8-cc71-40ee-a597-cb3860430493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfdb81a8-cc71-40ee-a597-cb3860430493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e69786-d109-4b9d-8482-f9b9d60d3a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68e69786-d109-4b9d-8482-f9b9d60d3a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1ef0cf0-dfa1-4c22-a077-73e04b5212b5', 'volume_name': 'volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a2367-f3fd-4a27-96c9-c58a7fde1229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (261a2367-f3fd-4a27-96c9-c58a7fde1229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cb2f85-d210-4ac5-913e-9420c1be2b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume d1ef0cf0-dfa1-4c22-a077-73e04b5212b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5', 'volume_size': 1} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 1073741824" returned: 0 in 0.690s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:04 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 Sep 28 16:29:04 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Flow 'volume_create_manager' (060e053e-f89d-4aaf-84cc-ce2a4f292224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dece9c05-a876-4ad8-971c-e76f247e09c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dece9c05-a876-4ad8-971c-e76f247e09c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b101512b-a28e-443c-b48b-00699c29b213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5be63d724b4db986b2a54b5f9232da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:05Z,use_quota=True,user_id='ddd2521ba1934a14876439043888cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09b6ca4-c167-4893-8b54-405748d37fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a09b6ca4-c167-4893-8b54-405748d37fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4ea7ef-155c-4e5f-9f26-46a806fc6820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad4ea7ef-155c-4e5f-9f26-46a806fc6820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b101512b-a28e-443c-b48b-00699c29b213', 'volume_name': 'volume-b101512b-a28e-443c-b48b-00699c29b213', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d6f5ed-ee5f-42b3-be43-1d180baa856e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d6f5ed-ee5f-42b3-be43-1d180baa856e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01054210-dcd1-4236-84d6-a47a38f4cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Volume b101512b-a28e-443c-b48b-00699c29b213: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b101512b-a28e-443c-b48b-00699c29b213', 'volume_size': 1} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:04 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9" returned: 0 in 0.334s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291298313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1ef0cf0-dfa1-4c22-a077-73e04b5212b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:04Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:04 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:04 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 1073741824 Sep 28 16:29:04 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400a6c60-a739-4b02-a9be-de74eb1fa322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b75b4077-1335-4e4a-986b-70dfffe91ec9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae30b183-dbd8-44b4-9cab-1cea168bbaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:04 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 (b75b4077-1335-4e4a-986b-70dfffe91ec9): created successfully Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae30b183-dbd8-44b4-9cab-1cea168bbaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:04 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (0e2bb1a1-a78d-478a-88d7-047dca1d0937) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:05 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3bb0c8c8-1e82-4748-8795-db3efce66660 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (25019eef-0d2f-48ac-bd9f-c4195644752b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6930295-d307-4079-aa4f-d8239586fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6930295-d307-4079-aa4f-d8239586fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1431639054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca297d84-32ab-42c6-8612-6fc5f8a6b3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:05Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830128ec-f04f-4bbd-b899-e84924d07cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830128ec-f04f-4bbd-b899-e84924d07cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e186ac91-52a6-4adf-8ce4-1de3e7a24d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e186ac91-52a6-4adf-8ce4-1de3e7a24d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca297d84-32ab-42c6-8612-6fc5f8a6b3c1', 'volume_name': 'volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4153e3d-2da8-4331-9469-21c23ddf51e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4153e3d-2da8-4331-9469-21c23ddf51e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502aa753-e979-4064-8aa6-581e65e857a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:05 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume ca297d84-32ab-42c6-8612-6fc5f8a6b3c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1', 'volume_size': 1} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:05 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 1073741824" returned: 0 in 0.734s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:05 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 Sep 28 16:29:05 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:06 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" returned: 0 in 0.360s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.284s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:04Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b101512b-a28e-443c-b48b-00699c29b213,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5be63d724b4db986b2a54b5f9232da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:05Z,use_quota=True,user_id='ddd2521ba1934a14876439043888cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Creating volume b101512b-a28e-443c-b48b-00699c29b213 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (295c677c-04fc-49d4-abfe-026a49167437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233a4560-ff16-4777-95e2-0e798a2ad828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 1073741824 Sep 28 16:29:06 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cb2f85-d210-4ac5-913e-9420c1be2b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cc1c8a-c001-422c-af7c-2968ad7a8c9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (233a4560-ff16-4777-95e2-0e798a2ad828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674708779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a389bc7-0e9b-49e5-98eb-73136ddcc9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:06Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c16d863-92eb-46f2-b9ac-4184cc652caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c16d863-92eb-46f2-b9ac-4184cc652caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f52d1-6fa1-484f-9596-e5f6c199c0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (702f52d1-6fa1-484f-9596-e5f6c199c0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a389bc7-0e9b-49e5-98eb-73136ddcc9a6', 'volume_name': 'volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6799a3bc-17eb-46be-b3cf-41a676f99908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6799a3bc-17eb-46be-b3cf-41a676f99908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a9f332-1301-4e46-b2b9-920976efd922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume 1a389bc7-0e9b-49e5-98eb-73136ddcc9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6', 'volume_size': 1} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 (d1ef0cf0-dfa1-4c22-a077-73e04b5212b5): created successfully Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00cc1c8a-c001-422c-af7c-2968ad7a8c9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (4fbf5592-802c-4667-b9c8-92e96c81516b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-53d0a484-beb0-4096-a857-213fadca088b tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (15fb8b98-9f0c-484a-97b3-6fd803881bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eb3eca-0625-499e-8a72-3a2880b550e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42eb3eca-0625-499e-8a72-3a2880b550e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954004280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b125d55-11a1-4d1f-9e6d-d82ef7a799cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:06Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1678dbc1-3c20-4ce3-9d75-e5ea31a859a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1678dbc1-3c20-4ce3-9d75-e5ea31a859a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d337e819-3714-403e-b4e1-8facf85f1781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d337e819-3714-403e-b4e1-8facf85f1781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b125d55-11a1-4d1f-9e6d-d82ef7a799cb', 'volume_name': 'volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b48fb3-51a6-4ad1-8382-d4f9ecd7fd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5b48fb3-51a6-4ad1-8382-d4f9ecd7fd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26e952-5545-4d9b-a370-78e6c7bbd091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume 8b125d55-11a1-4d1f-9e6d-d82ef7a799cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb', 'volume_size': 1} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:06 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 1073741824" returned: 0 in 0.648s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:06 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 Sep 28 16:29:06 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:07 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213" returned: 0 in 0.290s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1431639054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca297d84-32ab-42c6-8612-6fc5f8a6b3c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:05Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:07 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01054210-dcd1-4236-84d6-a47a38f4cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b101512b-a28e-443c-b48b-00699c29b213', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:07 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 1073741824 Sep 28 16:29:07 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92e0189-196e-4c42-94cb-1d8151000027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:07 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Volume volume-b101512b-a28e-443c-b48b-00699c29b213 (b101512b-a28e-443c-b48b-00699c29b213): created successfully Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d92e0189-196e-4c42-94cb-1d8151000027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Flow 'volume_create_manager' (060e053e-f89d-4aaf-84cc-ce2a4f292224) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b64dc905-92a7-4c5e-a351-4371275106dc tempest-CinderUnicodeTest-27999300 None] Created volume successfully. Sep 28 16:29:07 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 1073741824" returned: 0 in 0.586s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:07 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 Sep 28 16:29:07 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:07 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" returned: 0 in 0.273s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.704s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-674708779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a389bc7-0e9b-49e5-98eb-73136ddcc9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:06Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume 1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:08 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502aa753-e979-4064-8aa6-581e65e857a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 1073741824 Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea0376d-d51b-42f5-b4ba-e404bd4c1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 (ca297d84-32ab-42c6-8612-6fc5f8a6b3c1): created successfully Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea0376d-d51b-42f5-b4ba-e404bd4c1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (25019eef-0d2f-48ac-bd9f-c4195644752b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:08 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-52204ae5-1ef8-46ef-9189-e719b6a01005 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:29:08 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 1073741824" returned: 0 in 0.671s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:08 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 Sep 28 16:29:08 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Flow 'volume_create_manager' (831bcd04-7a83-48e6-9e2d-08d4769fad25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5b1c97-ef6d-42eb-80a4-38a0efb576d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5b1c97-ef6d-42eb-80a4-38a0efb576d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1471066469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c699fa22-404f-4d0b-8dc0-6a3f424a3062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5be63d724b4db986b2a54b5f9232da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:09Z,use_quota=True,user_id='ddd2521ba1934a14876439043888cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03bb675-f0bd-462f-b183-2082ce055aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e03bb675-f0bd-462f-b183-2082ce055aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93952d35-39f0-4986-93e3-8278539bfd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93952d35-39f0-4986-93e3-8278539bfd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c699fa22-404f-4d0b-8dc0-6a3f424a3062', 'volume_name': 'volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6a6f5e-21e3-4b04-931c-9e2fbd50341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6a6f5e-21e3-4b04-931c-9e2fbd50341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd88c4-4c59-49c5-a392-be0bed35e052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:08 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Volume c699fa22-404f-4d0b-8dc0-6a3f424a3062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062', 'volume_size': 1} Sep 28 16:29:08 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:09 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.503s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-954004280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b125d55-11a1-4d1f-9e6d-d82ef7a799cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f5d1090d4044479fe622f2de54f03a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:06Z,use_quota=True,user_id='802c8954b3934e628a5ab1dedda84fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Creating volume 8b125d55-11a1-4d1f-9e6d-d82ef7a799cb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:09 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24a9f332-1301-4e46-b2b9-920976efd922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85a72c8-1fa8-44a8-8566-84fc3bd733d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:09 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb 1073741824 Sep 28 16:29:09 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:09 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 (1a389bc7-0e9b-49e5-98eb-73136ddcc9a6): created successfully Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d85a72c8-1fa8-44a8-8566-84fc3bd733d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (295c677c-04fc-49d4-abfe-026a49167437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:09 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-092b70cb-9f1a-4d15-9544-3f0944149a19 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:29:09 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb 1073741824" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:09 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb Sep 28 16:29:09 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:10 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:08Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1471066469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c699fa22-404f-4d0b-8dc0-6a3f424a3062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b5be63d724b4db986b2a54b5f9232da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:09Z,use_quota=True,user_id='ddd2521ba1934a14876439043888cd75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Creating volume c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:10 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa26e952-5545-4d9b-a370-78e6c7bbd091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f39e3ea-bd58-4d65-a45f-e40165c4034a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:10 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 1073741824 Sep 28 16:29:10 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:10 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Volume volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb (8b125d55-11a1-4d1f-9e6d-d82ef7a799cb): created successfully Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f39e3ea-bd58-4d65-a45f-e40165c4034a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Flow 'volume_create_manager' (15fb8b98-9f0c-484a-97b3-6fd803881bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:10 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fbda1ef7-26b7-45b1-be71-194f0928cbdb tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created volume successfully. Sep 28 16:29:10 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 1073741824" returned: 0 in 0.569s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:10 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 Sep 28 16:29:10 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:10 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6cd88c4-4c59-49c5-a392-be0bed35e052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1146f3e-9db7-4646-849a-cd62e32b2e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:11 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Volume volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 (c699fa22-404f-4d0b-8dc0-6a3f424a3062): created successfully Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1146f3e-9db7-4646-849a-cd62e32b2e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Flow 'volume_create_manager' (831bcd04-7a83-48e6-9e2d-08d4769fad25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-61f9b253-fd14-43aa-b2f4-4a8e0da08e5c tempest-CinderUnicodeTest-27999300 None] Created volume successfully. Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83c7e2-4589-4890-8004-dbe74b1ffe74]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:11 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb Sep 28 16:29:11 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:11 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" returned: 0 in 0.482s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:11 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb Sep 28 16:29:11 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:12 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" returned: 0 in 0.497s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb" released by "delete_volume" :: held 1.080s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['c0c77be9-dd5e-459d-bd19-31887db48b7a', 'aee41bf8-6193-43af-bd2d-67e4a747677f', '8941a582-f7a7-4080-9c49-e7a9c554c4ff', 'c26a66de-5f31-444c-a1d4-2f9b455b1c29'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Creating offline snapshot beb10777-cd69-4595-992b-6ae74d79fe6c of volume c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc08246-98bf-41e4-a78e-1e2e3683ef62]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:12 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:12 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:12 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 Sep 28 16:29:12 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:12 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.332s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:12 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:12 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ad5db26b-d8c4-49a5-b91d-5c4dd9c1490d tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-8b125d55-11a1-4d1f-9e6d-d82ef7a799cb-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:13 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:13 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c 1G Sep 28 16:29:13 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b5f2dd-cbbb-4bfb-9e90-41fe882c17bd]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:13 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c 1G" returned: 0 in 0.606s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:13 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c Sep 28 16:29:13 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:13 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 Sep 28 16:29:13 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:14 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:14 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c is being set with open permissions: ugo+rw Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:14 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c Sep 28 16:29:14 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:14 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" returned: 0 in 0.550s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:14 devstack sudo[107439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6 Sep 28 16:29:14 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:14 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c" returned: 0 in 0.339s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:14 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info Sep 28 16:29:14 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:14 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6" released by "delete_volume" :: held 1.045s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['d3556283-c80b-429d-97e2-994e10b8caf5', 'e07d48f5-9353-4d6e-b1fa-111e8f64b394', 'c2346dc6-fe6d-418a-9e92-2438e5e311e2', '17a0bc95-91d8-4731-bdf0-ee4a3c6c0392'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:14 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info" returned: 0 in 0.403s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:14 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info is being set with open permissions: ugo+rw Sep 28 16:29:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:14 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:14 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:14 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info Sep 28 16:29:14 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:15 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.314s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:15 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-10fdf6d7-0a08-4bba-b978-f76a7950e432 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-1a389bc7-0e9b-49e5-98eb-73136ddcc9a6-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.info" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.755s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-20f96e04-0cf8-4e78-b4a8-21c9ae09245a tempest-CinderUnicodeTest-27999300 None] Create snapshot completed successfully Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-beb10777-cd69-4595-992b-6ae74d79fe6c-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-beb10777-cd69-4595-992b-6ae74d79fe6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-quobyte-beb10777-cd69-4595-992b-6ae74d79fe6c" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-beb10777-cd69-4595-992b-6ae74d79fe6c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Deleting offline snapshot beb10777-cd69-4595-992b-6ae74d79fe6c of volume c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] snapshot_file for this snap is: volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a890c792-79ef-4934-ab60-1afa163eb23d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" acquired by "delete_volume" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d9b10f-fad7-4f7f-be40-1b10402828ab]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:16 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c Sep 28 16:29:16 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:16 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 Sep 28 16:29:16 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:16 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" returned: 0 in 0.537s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:16 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:16 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1 Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c" returned: 0 in 0.651s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:29:16 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a033e3-f744-4fa8-8908-b92fbce8277e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:16 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 Sep 28 16:29:16 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:16 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" returned: 0 in 0.378s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1" released by "delete_volume" :: held 0.978s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['efc5d772-116c-4799-aa47-aaeec1654a3a', 'd108c1b8-1504-42cd-b12c-59660ce3671f', '5cbe3f6e-5b7a-47be-a0a9-6e71ebc23165', 'a0ba16c2-9551-419e-8342-78c414ff6d81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:17 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062" returned: 0 in 0.530s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:17 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:17 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:17 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c Sep 28 16:29:17 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:17 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.331s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b7332a5e-8a18-428b-bbe2-ee8c525b9450 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-ca297d84-32ab-42c6-8612-6fc5f8a6b3c1-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:17 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c" returned: 0 in 0.449s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:17 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c Sep 28 16:29:17 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:18 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062.beb10777-cd69-4595-992b-6ae74d79fe6c" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-beb10777-cd69-4595-992b-6ae74d79fe6c" released by "_delete_snapshot" :: held 2.268s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" released by "delete_snapshot" :: held 2.322s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Created reservations ['8e8887c0-bfc6-4507-9052-12b7956087ca', '424a919f-483d-443b-b704-cb4972d0a5c4', 'f3f67849-c633-4eec-9995-45e5c3e74452', 'd9c2fda1-2230-40f6-b621-1b28fbea44a2'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" acquired by "delete_volume" :: waited 0.049s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7cf9da-c866-43da-9566-5bf1125fd33b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Delete snapshot completed successfully. Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df801f8b-7a43-4df7-a323-c3641d5b0629 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-beb10777-cd69-4595-992b-6ae74d79fe6c-delete_snapshot" released by "delete_snapshot" :: held 2.747s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:18 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 Sep 28 16:29:18 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:18 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" returned: 0 in 0.461s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:18 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5 Sep 28 16:29:18 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-c699fa22-404f-4d0b-8dc0-6a3f424a3062-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "cinder-c699fa22-404f-4d0b-8dc0-6a3f424a3062-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa6ea63-8203-4cd2-8666-1006c4f7bc64]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:19 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5" released by "delete_volume" :: held 0.953s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['76d79fa2-48bb-4298-ba4e-752fb165467c', '64be5f0d-04cc-4475-a5b0-3391b3cfdf52', 'e02ad50b-7874-4bde-837f-3b29bcad87c2', 'b0538131-8b90-4679-b64b-26421bfafbee'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:19 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 Sep 28 16:29:19 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:19 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:19 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:19 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062" returned: 0 in 0.589s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:19 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062 Sep 28 16:29:19 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:19 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ef34db47-5d3a-4edd-8113-10dcdc6738ee tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-d1ef0cf0-dfa1-4c22-a077-73e04b5212b5-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:20 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c699fa22-404f-4d0b-8dc0-6a3f424a3062" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-c699fa22-404f-4d0b-8dc0-6a3f424a3062" released by "delete_volume" :: held 1.039s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Created reservations ['7539b8e8-62fe-41e2-a1fa-08711fd4138c', '8ad964d9-36b6-4de0-b0d7-16d536eeeb83', 'eb4aca40-ad96-4834-a8a6-232e86d8f121', 'a5cd5286-6617-4a29-8472-8dbe68b564da'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:20 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:20 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-b75b4077-1335-4e4a-986b-70dfffe91ec9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-b75b4077-1335-4e4a-986b-70dfffe91ec9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=185,cinder:UPDATE=246,cinder:INSERT=65,cinder:DELETE=22 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:UPDATE=250,cinder:SELECT=177,cinder:DELETE=23,cinder:INSERT=68 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-b75b4077-1335-4e4a-986b-70dfffe91ec9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-b75b4077-1335-4e4a-986b-70dfffe91ec9" acquired by "delete_volume" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff3522-188e-4ba9-9c02-99e009ad4706]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:20 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Deleted volume successfully. Sep 28 16:29:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f22d5045-80f8-4b9c-bd99-9b9c3dcbc5ab tempest-CinderUnicodeTest-27999300 None] Lock "cinder-c699fa22-404f-4d0b-8dc0-6a3f424a3062-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:20 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 Sep 28 16:29:20 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:21 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9" returned: 0 in 0.538s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:21 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9 Sep 28 16:29:21 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-b101512b-a28e-443c-b48b-00699c29b213-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-b101512b-a28e-443c-b48b-00699c29b213-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:21 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "cinder-quobyte-b101512b-a28e-443c-b48b-00699c29b213" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b75b4077-1335-4e4a-986b-70dfffe91ec9" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-b75b4077-1335-4e4a-986b-70dfffe91ec9" released by "delete_volume" :: held 0.945s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-b101512b-a28e-443c-b48b-00699c29b213" acquired by "delete_volume" :: waited 0.038s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b075fd3-c9ca-474c-843f-93841ae602ac]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['456c10be-b9d8-4f81-8d56-253d7bf6cd3d', 'be3821b2-64a8-48bd-83df-df149d93363a', '3bf805fd-9ab8-4db9-a9ff-0fc7fa7364fb', '1d593508-2a37-41cb-9049-ff85256aa67e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:21 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 Sep 28 16:29:21 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:21 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:21 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:22 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:22 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213" returned: 0 in 0.505s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-beb09a17-0276-4aa0-ae76-94bf39e4c7d9 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-b75b4077-1335-4e4a-986b-70dfffe91ec9-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:22 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213 Sep 28 16:29:22 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:22 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-b101512b-a28e-443c-b48b-00699c29b213" returned: 0 in 0.327s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-quobyte-b101512b-a28e-443c-b48b-00699c29b213" released by "delete_volume" :: held 0.903s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Created reservations ['34eff6d8-e9b2-479c-99fa-b62467475fa2', '5c0fa5c0-e8f6-4911-b231-f9a59477722d', '14c1cf28-0217-4a12-85cc-8e2071e73b00', '6ca1a0ce-e8a7-4554-b4f4-33e9f172e4b5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:22 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:22 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-00afd366-1bc7-4744-9fe3-c76d3959b7da-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-00afd366-1bc7-4744-9fe3-c76d3959b7da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-00afd366-1bc7-4744-9fe3-c76d3959b7da" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-00afd366-1bc7-4744-9fe3-c76d3959b7da" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleting offline snapshot 00afd366-1bc7-4744-9fe3-c76d3959b7da of volume a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:29:23 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] snapshot_file for this snap is: volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Deleted volume successfully. Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95635b3-283e-4171-87b4-816ab1a8599b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8faeecd5-7781-452b-926a-bc606cbd4448 tempest-CinderUnicodeTest-27999300 None] Lock "cinder-b101512b-a28e-443c-b48b-00699c29b213-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:23 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da Sep 28 16:29:23 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:23 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a3106c-83ec-461e-8a1f-b519751f52e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf4f005-95d0-4db8-ac7b-edabb76514d2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:23 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 Sep 28 16:29:23 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:24 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8" returned: 0 in 0.490s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:24 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da Sep 28 16:29:24 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:24 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da" returned: 0 in 0.504s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:24 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da Sep 28 16:29:24 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:24 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8.00afd366-1bc7-4744-9fe3-c76d3959b7da" returned: 0 in 0.335s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:24 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-00afd366-1bc7-4744-9fe3-c76d3959b7da" released by "_delete_snapshot" :: held 1.967s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" released by "delete_snapshot" :: held 2.018s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:25 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['f5af27a4-a05b-4057-a5b1-d972b64f16da', 'c005b587-a9a9-4441-96af-0d8b797166fc', '486f9a02-f2a3-45f1-aba2-fa87415d40f0', '9e09c595-2e28-48fa-a135-4cc6fcbcf20b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Delete snapshot completed successfully. Sep 28 16:29:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8335e2e5-65aa-4f55-913b-8dacc91bf029 tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-00afd366-1bc7-4744-9fe3-c76d3959b7da-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-a3a3106c-83ec-461e-8a1f-b519751f52e8-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-a3a3106c-83ec-461e-8a1f-b519751f52e8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" acquired by "delete_volume" :: waited 0.037s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a96568-1dbb-4f92-aed4-ab6cab8a6d3d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:26 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 Sep 28 16:29:26 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:27 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8" returned: 0 in 0.535s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:27 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8 Sep 28 16:29:27 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:27 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a3a3106c-83ec-461e-8a1f-b519751f52e8" returned: 0 in 0.359s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-quobyte-a3a3106c-83ec-461e-8a1f-b519751f52e8" released by "delete_volume" :: held 1.015s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Created reservations ['b8f1e160-9cf4-48f0-9f1e-f4e773534cb7', '7ca97f54-8012-496f-85bb-b2911f5bec44', 'e748c119-0c3f-4696-af0f-6fa5c2ef06a9', 'e032fe89-6ddc-4595-93a6-f3eeb81f4ada'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:27 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:27 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:27 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:27 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Deleted volume successfully. Sep 28 16:29:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-41d07ddd-39d5-4ebb-b005-3514a52bfbde tempest-CreateVolumesFromSnapshotTest-1411432887 None] Lock "cinder-a3a3106c-83ec-461e-8a1f-b519751f52e8-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (495d2e56-3b2a-4f12-ad97-8ee70cee3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08195b8b-e497-4ed4-b80f-5e21db895aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08195b8b-e497-4ed4-b80f-5e21db895aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712085689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18896463-9bcd-4ca7-b643-bd92cd6e2ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:29Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46643812-6793-4e46-84e0-fdda58e57b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46643812-6793-4e46-84e0-fdda58e57b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7514306-8d97-49e7-96f4-bd3d04f9b45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7514306-8d97-49e7-96f4-bd3d04f9b45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18896463-9bcd-4ca7-b643-bd92cd6e2ced', 'volume_name': 'volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08c3fd0-a73a-442e-a537-47b4315ba18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08c3fd0-a73a-442e-a537-47b4315ba18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59cbab5-2d6c-4bd7-a772-a64963eb2df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Volume 18896463-9bcd-4ca7-b643-bd92cd6e2ced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced', 'volume_size': 1} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-712085689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18896463-9bcd-4ca7-b643-bd92cd6e2ced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:29Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Creating volume 18896463-9bcd-4ca7-b643-bd92cd6e2ced {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:29 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced 1073741824 Sep 28 16:29:29 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:29 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced 1073741824" returned: 0 in 0.699s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:30 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced Sep 28 16:29:30 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:30 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced" returned: 0 in 0.318s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a59cbab5-2d6c-4bd7-a772-a64963eb2df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21656655-45c4-4e7d-83e6-8ea3ba803ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:30 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Volume volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced (18896463-9bcd-4ca7-b643-bd92cd6e2ced): created successfully Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21656655-45c4-4e7d-83e6-8ea3ba803ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:30 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (495d2e56-3b2a-4f12-ad97-8ee70cee3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:30 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-5e75bc9f-2ac3-4c34-9203-8b6577662cbe tempest-ProjectReaderTests-16343667 None] Created volume successfully. Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-18896463-9bcd-4ca7-b643-bd92cd6e2ced-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "cinder-18896463-9bcd-4ca7-b643-bd92cd6e2ced-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-quobyte-18896463-9bcd-4ca7-b643-bd92cd6e2ced" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-18896463-9bcd-4ca7-b643-bd92cd6e2ced" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2a65ed-27e6-4f76-ba45-167f6e33eba9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:31 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced Sep 28 16:29:31 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:32 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced" returned: 0 in 0.621s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:32 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced Sep 28 16:29:32 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:32 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-18896463-9bcd-4ca7-b643-bd92cd6e2ced" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-18896463-9bcd-4ca7-b643-bd92cd6e2ced" released by "delete_volume" :: held 1.082s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Created reservations ['7f5c1939-2f1a-4d59-bacc-237eb9a16d7d', '2fb558ed-9ef8-46b0-abb1-56984e5c4728', 'fe2660c4-e9b7-4e30-a819-f4327d2f7a9b', 'a032cf6a-b640-49d1-9ca1-99641baa771c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:33 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:33 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:33 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:33 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:33 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Deleted volume successfully. Sep 28 16:29:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-136cd1b2-3fd4-4846-adcb-5bd240264234 tempest-ProjectReaderTests-16343667 None] Lock "cinder-18896463-9bcd-4ca7-b643-bd92cd6e2ced-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (e5ecfde4-7bb4-4f0f-8d5d-18d3c0610df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7a8034-38a6-40d9-b60b-74861a92a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca7a8034-38a6-40d9-b60b-74861a92a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650190435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dd2887-b788-4f55-9bd7-2848a5704a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:35Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c70025e-7711-4139-b321-7a200405ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c70025e-7711-4139-b321-7a200405ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b58442-16a8-453a-ab9a-7ce8aeef7ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82b58442-16a8-453a-ab9a-7ce8aeef7ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73dd2887-b788-4f55-9bd7-2848a5704a07', 'volume_name': 'volume-73dd2887-b788-4f55-9bd7-2848a5704a07', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600b4d10-3160-4f7b-a15d-ae5f1c80739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (600b4d10-3160-4f7b-a15d-ae5f1c80739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31e8ce9-ef3b-4eae-920c-cf57e64aeb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:34 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Volume 73dd2887-b788-4f55-9bd7-2848a5704a07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73dd2887-b788-4f55-9bd7-2848a5704a07', 'volume_size': 1} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-650190435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73dd2887-b788-4f55-9bd7-2848a5704a07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:35Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Creating volume 73dd2887-b788-4f55-9bd7-2848a5704a07 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:34 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:34 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 1073741824 Sep 28 16:29:34 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:35 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 1073741824" returned: 0 in 0.757s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:35 devstack sudo[107592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 Sep 28 16:29:35 devstack sudo[107592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:36 devstack sudo[107592]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07" returned: 0 in 0.348s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] <== create_volume: return (1186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b31e8ce9-ef3b-4eae-920c-cf57e64aeb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73dd2887-b788-4f55-9bd7-2848a5704a07', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a690ba8-dcbd-4513-ba6f-30e0eea8b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Volume volume-73dd2887-b788-4f55-9bd7-2848a5704a07 (73dd2887-b788-4f55-9bd7-2848a5704a07): created successfully Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a690ba8-dcbd-4513-ba6f-30e0eea8b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (e5ecfde4-7bb4-4f0f-8d5d-18d3c0610df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:36 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-919f7bfb-83c4-4399-bc78-f9ff36644a7a tempest-ProjectReaderTests-16343667 None] Created volume successfully. Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:36 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:36 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:36 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:29:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-73dd2887-b788-4f55-9bd7-2848a5704a07-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "cinder-73dd2887-b788-4f55-9bd7-2848a5704a07-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-quobyte-73dd2887-b788-4f55-9bd7-2848a5704a07" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-73dd2887-b788-4f55-9bd7-2848a5704a07" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dceb591-2dbd-4bdb-afc9-d10eea700cd8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:37 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 Sep 28 16:29:37 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:37 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07" returned: 0 in 0.608s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:37 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07 Sep 28 16:29:37 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:38 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-73dd2887-b788-4f55-9bd7-2848a5704a07" returned: 0 in 0.485s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-73dd2887-b788-4f55-9bd7-2848a5704a07" released by "delete_volume" :: held 1.199s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Created reservations ['1596df48-748f-4cd2-adb8-4b084e4c91ab', 'ab7bd03c-00da-42c7-8fc0-13a5ca60292e', 'b524e318-41f3-433b-8f9a-b648fd60fdc2', '450665ee-cebe-4175-a9d3-b1d39c336bd3'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:38 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:38 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (061ed78b-cc08-42f2-b3fd-191a12ac6df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5975a213-419a-45c1-9cc1-a5b4a05cffce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5975a213-419a-45c1-9cc1-a5b4a05cffce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519347997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7092eed-eb1e-4f5c-9449-17bf45c8aee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:39Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba228a-5ae1-4a35-b157-f0a17bacc141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dba228a-5ae1-4a35-b157-f0a17bacc141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34276d2-89b3-412e-ae61-6211f8dcfaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34276d2-89b3-412e-ae61-6211f8dcfaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7092eed-eb1e-4f5c-9449-17bf45c8aee1', 'volume_name': 'volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8e1a83-1ed9-4b4b-a1ac-66fac46493f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8e1a83-1ed9-4b4b-a1ac-66fac46493f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab099b-a2af-4397-8240-8e2dfe9f8c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:38 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Volume a7092eed-eb1e-4f5c-9449-17bf45c8aee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1', 'volume_size': 1} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-519347997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7092eed-eb1e-4f5c-9449-17bf45c8aee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:39Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Creating volume a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:38 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:38 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 1073741824 Sep 28 16:29:38 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:39 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.474s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Deleted volume successfully. Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b112be6e-835e-4d56-bfa1-d3265cc8e906 tempest-ProjectReaderTests-16343667 None] Lock "cinder-73dd2887-b788-4f55-9bd7-2848a5704a07-delete_volume" released by "delete_volume" :: held 2.048s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:39 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 1073741824" returned: 0 in 0.829s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:39 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 Sep 28 16:29:39 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Flow 'volume_create_manager' (4efad085-9e95-4b6e-8ab6-567a92d29684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c850b80-e4e3-43f4-b47a-89ec97fc27c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c850b80-e4e3-43f4-b47a-89ec97fc27c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1893641135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e641690f-d4aa-4d7e-996a-818169d371b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d7008526f24068b1cd887808da8066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:40Z,use_quota=True,user_id='05f1dac8172e4031bfd60e22db1899d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaa93eb-f0d1-4cb0-80e0-0c7818a9ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eaa93eb-f0d1-4cb0-80e0-0c7818a9ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d622c2-5584-46e0-bc2b-339af47fcdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d622c2-5584-46e0-bc2b-339af47fcdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e641690f-d4aa-4d7e-996a-818169d371b7', 'volume_name': 'volume-e641690f-d4aa-4d7e-996a-818169d371b7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb117cac-f89b-4d4a-a253-fbc570e34e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb117cac-f89b-4d4a-a253-fbc570e34e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8046a9c1-6464-4e12-bef9-edecf48f25bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Volume e641690f-d4aa-4d7e-996a-818169d371b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e641690f-d4aa-4d7e-996a-818169d371b7', 'volume_size': 1} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:39 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" returned: 0 in 0.299s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1893641135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e641690f-d4aa-4d7e-996a-818169d371b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d7008526f24068b1cd887808da8066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:40Z,use_quota=True,user_id='05f1dac8172e4031bfd60e22db1899d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Creating volume e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:40 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 1073741824 Sep 28 16:29:40 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ab099b-a2af-4397-8240-8e2dfe9f8c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ae4971-49ef-4c47-902d-d2278bd4476e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Volume volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 (a7092eed-eb1e-4f5c-9449-17bf45c8aee1): created successfully Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ae4971-49ef-4c47-902d-d2278bd4476e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (061ed78b-cc08-42f2-b3fd-191a12ac6df6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (3bf48d59-2088-4d2e-89af-badd1d9f3e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477e65f5-3d3c-4df1-8ea8-b253670100d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (477e65f5-3d3c-4df1-8ea8-b253670100d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761531651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe3ed7f-ea82-4f51-b72a-485df5e02a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:40Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5c7417-220c-485b-90a1-63c1f0097517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5c7417-220c-485b-90a1-63c1f0097517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7217a1e8-58dd-4c93-ba23-3ca9e94b5b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7217a1e8-58dd-4c93-ba23-3ca9e94b5b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fe3ed7f-ea82-4f51-b72a-485df5e02a9b', 'volume_name': 'volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82202fcf-dd3c-4a8c-8b59-e8d593163c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82202fcf-dd3c-4a8c-8b59-e8d593163c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510a6159-8e31-40f2-b5d3-ff646fb1b022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Volume 1fe3ed7f-ea82-4f51-b72a-485df5e02a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b', 'volume_size': 1} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-15c377c9-f213-4263-a219-fad59749ee64 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:29:40 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 1073741824" returned: 0 in 0.520s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:40 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:29:40 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:40 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.683s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-761531651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fe3ed7f-ea82-4f51-b72a-485df5e02a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:40Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Creating volume 1fe3ed7f-ea82-4f51-b72a-485df5e02a9b {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8046a9c1-6464-4e12-bef9-edecf48f25bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e641690f-d4aa-4d7e-996a-818169d371b7', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b 1073741824 Sep 28 16:29:40 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aaa01d0-b9dc-4dda-b3e5-33e28a9ff127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Volume volume-e641690f-d4aa-4d7e-996a-818169d371b7 (e641690f-d4aa-4d7e-996a-818169d371b7): created successfully Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aaa01d0-b9dc-4dda-b3e5-33e28a9ff127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Flow 'volume_create_manager' (4efad085-9e95-4b6e-8ab6-567a92d29684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7eb28a1e-3e55-483d-b239-beda5d75525f tempest-SnapshotDependencyTests-1857023687 None] Created volume successfully. Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:41 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b 1073741824" returned: 0 in 0.524s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:41 devstack sudo[107635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b Sep 28 16:29:41 devstack sudo[107635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:41 devstack sudo[107635]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.661s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 68b6961e-088e-419d-8163-5f19469ed2c4 of volume a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510a6159-8e31-40f2-b5d3-ff646fb1b022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744bac67-001b-481a-b00e-55ecbfab633c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5340a6-addf-42b5-8e8e-e41c6d064e59]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:41 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Volume volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b (1fe3ed7f-ea82-4f51-b72a-485df5e02a9b): created successfully Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744bac67-001b-481a-b00e-55ecbfab633c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:41 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (3bf48d59-2088-4d2e-89af-badd1d9f3e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6ee54100-9d7e-411d-8427-2f9d657c7c4a tempest-ProjectReaderTests-16343667 None] Created volume successfully. Sep 28 16:29:41 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 Sep 28 16:29:41 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:42 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" returned: 0 in 0.513s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "cinder-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:42 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 1G Sep 28 16:29:42 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-quobyte-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d80949-3f1e-4b16-a999-036ea087b1e5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:42 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b Sep 28 16:29:42 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:42 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 1G" returned: 0 in 0.522s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:42 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 Sep 28 16:29:42 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:42 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:42 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b Sep 28 16:29:42 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:43 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:43 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 is being set with open permissions: ugo+rw Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:43 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 Sep 28 16:29:43 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:43 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" returned: 0 in 0.301s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b" released by "delete_volume" :: held 0.791s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Created reservations ['debaf8c7-5e14-4d5c-86f6-ed1ba8d79c9b', 'a1f52e8b-46f9-4ece-aaa4-022feef0d1ce', 'c2c9e1d2-dfa4-4127-99ab-e497b79fda47', '7104c1b4-2682-48e5-bcd4-3380f6a7d6e0'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:43 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:43 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:43 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4" returned: 0 in 0.320s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:43 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info Sep 28 16:29:43 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:43 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:43 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Deleted volume successfully. Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c9ff0bab-c1a6-4cbc-a957-9412708e44b7 tempest-ProjectReaderTests-16343667 None] Lock "cinder-1fe3ed7f-ea82-4f51-b72a-485df5e02a9b-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:43 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info" returned: 0 in 0.339s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:43 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info is being set with open permissions: ugo+rw Sep 28 16:29:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:43 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info Sep 28 16:29:43 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (4d4c12bb-9425-40b9-ab73-b3200c6c2de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f8591f-2a26-49f8-999f-f694402b5e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3f8591f-2a26-49f8-999f-f694402b5e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089967324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3113beb-c736-4363-a175-f549c9342270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:44Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eabe7e-2bde-481e-a448-6cc165aa2603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10eabe7e-2bde-481e-a448-6cc165aa2603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba601eb-6f5c-410f-a078-70204fb795e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ba601eb-6f5c-410f-a078-70204fb795e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3113beb-c736-4363-a175-f549c9342270', 'volume_name': 'volume-c3113beb-c736-4363-a175-f549c9342270', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cacc05a-9c03-473a-9c01-2cde8641d863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cacc05a-9c03-473a-9c01-2cde8641d863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:44 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273b1139-71eb-4708-9afc-eaa8bc0a4fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Volume c3113beb-c736-4363-a175-f549c9342270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3113beb-c736-4363-a175-f549c9342270', 'volume_size': 1} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.info" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.451s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Creating offline snapshot f95c35ea-a89e-44eb-92ba-51cac2a069be of volume e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:29:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4967d216-39ef-4a29-9790-ea5a0e4163b7 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6e317e-6c9c-462c-8bb1-1dea6674b31b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:44 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:29:44 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:44 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:44 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be 1G Sep 28 16:29:44 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:44 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Flow 'volume_create_manager' (3d48d83a-ea9e-4e20-b1f9-807bf7eb646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1f62c8-c859-45d7-b406-c5e87b9552df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1f62c8-c859-45d7-b406-c5e87b9552df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917112400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792181b7-429f-4aa5-b63d-e4aeaf8c73eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fa05e0ba304928af2f5c9bc15c1609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:45Z,use_quota=True,user_id='442369d1ca3e490a8a3780a8107f8874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a4d9d-7d95-43e1-966e-4ddcac67534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (242a4d9d-7d95-43e1-966e-4ddcac67534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602bee6c-69a5-4692-87d6-fe7a877b0eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602bee6c-69a5-4692-87d6-fe7a877b0eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '792181b7-429f-4aa5-b63d-e4aeaf8c73eb', 'volume_name': 'volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e60da8-7839-4721-ad90-e27a43903431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e60da8-7839-4721-ad90-e27a43903431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1458a6-7673-4cbf-b5e8-8f0e35406b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:45 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Volume 792181b7-429f-4aa5-b63d-e4aeaf8c73eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb', 'volume_size': 1} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:45 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be 1G" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e641690f-d4aa-4d7e-996a-818169d371b7 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:45 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e641690f-d4aa-4d7e-996a-818169d371b7 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:45 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-68b6961e-088e-419d-8163-5f19469ed2c4-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-68b6961e-088e-419d-8163-5f19469ed2c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-68b6961e-088e-419d-8163-5f19469ed2c4" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-68b6961e-088e-419d-8163-5f19469ed2c4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 68b6961e-088e-419d-8163-5f19469ed2c4 of volume a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1075b185-7acf-4775-8aa2-c430f2a01a46]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:45 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e641690f-d4aa-4d7e-996a-818169d371b7 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:45 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be is being set with open permissions: ugo+rw Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:45 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:45 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:45 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 Sep 28 16:29:45 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:45 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:45 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info Sep 28 16:29:45 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:45 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca1ca36-131b-46b9-b21d-8107c9b2ed66]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:45 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 Sep 28 16:29:45 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info is being set with open permissions: ugo+rw Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:46 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info Sep 28 16:29:46 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:46 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 Sep 28 16:29:46 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.info" returned: 0 in 0.298s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1089967324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3113beb-c736-4363-a175-f549c9342270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09ac19953354abda5e66153763600e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:44Z,use_quota=True,user_id='a7a3d6ff6ab84eeebfeeec7cf11cb755',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Creating volume c3113beb-c736-4363-a175-f549c9342270 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:46 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 1073741824 Sep 28 16:29:46 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e016155a-1aa8-42a1-9d62-5c24637789d2 tempest-SnapshotDependencyTests-1857023687 None] Create snapshot completed successfully Sep 28 16:29:46 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:46 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4 Sep 28 16:29:46 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 1073741824" returned: 0 in 0.491s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:46 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 Sep 28 16:29:46 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:46 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1.68b6961e-088e-419d-8163-5f19469ed2c4" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-68b6961e-088e-419d-8163-5f19469ed2c4" released by "_delete_snapshot" :: held 1.660s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" released by "delete_snapshot" :: held 1.683s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Created reservations ['ff3d561c-f707-4a23-91f9-10ce556ebaa1', 'f0edb41f-ebd9-4499-b567-900a27ec7c48', '1d36eb4d-8a7c-4b0e-b235-f8187f2657fc', '95ae389b-2495-41b1-b598-8006cf6107bc'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-f05489e9-4f4d-4a4f-9d87-6e2d151bf425 tempest-ProjectMemberTests-255213367 None] Lock "cinder-68b6961e-088e-419d-8163-5f19469ed2c4-delete_snapshot" released by "delete_snapshot" :: held 1.845s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:47 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270" returned: 0 in 0.304s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1917112400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=792181b7-429f-4aa5-b63d-e4aeaf8c73eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fa05e0ba304928af2f5c9bc15c1609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:45Z,use_quota=True,user_id='442369d1ca3e490a8a3780a8107f8874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Creating volume 792181b7-429f-4aa5-b63d-e4aeaf8c73eb {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:47 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (273b1139-71eb-4708-9afc-eaa8bc0a4fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3113beb-c736-4363-a175-f549c9342270', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:47 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb 1073741824 Sep 28 16:29:47 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e146b2-f71d-4da6-852e-24ba28233345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Volume volume-c3113beb-c736-4363-a175-f549c9342270 (c3113beb-c736-4363-a175-f549c9342270): created successfully Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e146b2-f71d-4da6-852e-24ba28233345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Flow 'volume_create_manager' (4d4c12bb-9425-40b9-ab73-b3200c6c2de5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-df40089a-921d-4d15-9432-e7b3734668a8 tempest-ProjectReaderTests-16343667 None] Created volume successfully. Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-a7092eed-eb1e-4f5c-9449-17bf45c8aee1-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "cinder-a7092eed-eb1e-4f5c-9449-17bf45c8aee1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c10409-6f49-46cf-99f5-fbefb5e63b78]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:47 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 Sep 28 16:29:47 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:47 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb 1073741824" returned: 0 in 0.585s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:47 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb Sep 28 16:29:47 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:48 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:48 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1 Sep 28 16:29:48 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:48 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" returned: 0 in 0.354s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1458a6-7673-4cbf-b5e8-8f0e35406b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5bc384-f73b-44f2-93e0-d219c4cb4c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Volume volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb (792181b7-429f-4aa5-b63d-e4aeaf8c73eb): created successfully Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5bc384-f73b-44f2-93e0-d219c4cb4c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Flow 'volume_create_manager' (3d48d83a-ea9e-4e20-b1f9-807bf7eb646c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Flow 'volume_create_manager' (50852840-6518-49f3-954e-a1735308edaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b1e574-c452-45dc-bc86-8e64caa22cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b1e574-c452-45dc-bc86-8e64caa22cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81da472e-05f2-4d87-8853-164b4be2fea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9d7008526f24068b1cd887808da8066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f95c35ea-a89e-44eb-92ba-51cac2a069be,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:48Z,use_quota=True,user_id='05f1dac8172e4031bfd60e22db1899d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37c47c-4287-40b0-92f5-d5e47f446301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca37c47c-4287-40b0-92f5-d5e47f446301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9e3fe3-544b-45e8-a37d-5b17622d0685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de9e3fe3-544b-45e8-a37d-5b17622d0685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '81da472e-05f2-4d87-8853-164b4be2fea5', 'volume_name': 'volume-81da472e-05f2-4d87-8853-164b4be2fea5', 'volume_size': 1, 'snapshot_id': 'f95c35ea-a89e-44eb-92ba-51cac2a069be'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563ce748-101b-4d53-93a9-123c27ec2649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (563ce748-101b-4d53-93a9-123c27ec2649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2982a7f2-c90a-41ff-acdb-04b2f2009c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:48 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Volume 81da472e-05f2-4d87-8853-164b4be2fea5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-81da472e-05f2-4d87-8853-164b4be2fea5', 'volume_size': 1, 'snapshot_id': 'f95c35ea-a89e-44eb-92ba-51cac2a069be'} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-c3113beb-c736-4363-a175-f549c9342270-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aeb3469a-514b-44aa-a6fd-659175ed701e tempest-ProjectReaderTests-1243720405 None] Created volume successfully. Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be-81da472e-05f2-4d87-8853-164b4be2fea5" by "_create_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "cinder-c3113beb-c736-4363-a175-f549c9342270-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be-81da472e-05f2-4d87-8853-164b4be2fea5" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Creating volume 81da472e-05f2-4d87-8853-164b4be2fea5 from snapshot f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" by "_copy_volume_from_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] snapshot: f95c35ea-a89e-44eb-92ba-51cac2a069be, volume: 81da472e-05f2-4d87-8853-164b4be2fea5, {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 28 16:29:48 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0f916-99fb-4909-82ab-9075a63aff43]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Acquiring lock "cinder-quobyte-c3113beb-c736-4363-a175-f549c9342270" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a7092eed-eb1e-4f5c-9449-17bf45c8aee1" released by "delete_volume" :: held 0.931s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-c3113beb-c736-4363-a175-f549c9342270" acquired by "delete_volume" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c174d8-7c2e-4af5-935e-5af1e362b31b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:48 devstack sudo[107745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:48 devstack sudo[107745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Created reservations ['dfdacd3a-31b6-468e-aae2-1245daf8f4b7', '932082b9-b5d0-43a5-bbcd-6aeebe2d9a47', '2b47bb7b-02d8-465a-a671-36f40b8473ac', 'cefbdb49-771f-4cf5-a894-6be5d1fbf1da'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:48 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 Sep 28 16:29:48 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:48 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:48 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:48 devstack sudo[107745]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.440s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e641690f-d4aa-4d7e-996a-818169d371b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1cc479-5ec9-4985-8980-80059c42d948]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:49 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270" returned: 0 in 0.433s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:49 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270 Sep 28 16:29:49 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:49 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.301s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:29:49 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:29:49 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-258843ba-0197-4aa0-ba3a-e2ff65207ee9 tempest-ProjectMemberTests-255213367 None] Lock "cinder-a7092eed-eb1e-4f5c-9449-17bf45c8aee1-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:49 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-c3113beb-c736-4363-a175-f549c9342270" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "cinder-quobyte-c3113beb-c736-4363-a175-f549c9342270" released by "delete_volume" :: held 0.788s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Created reservations ['fdd096a0-e96a-4ec5-b579-6919f1e93de2', 'eb8a2f8c-3761-48da-a734-f54891f907fa', '2aa3a291-7000-43df-a024-a680ba674b41', '7714a5a2-4195-47ae-a39c-9a98a3c08e2c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:49 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.489s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] will copy from snapshot at /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Creating direct copy from snapshot {{(pid=87150) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.utils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Path /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 not found in is_blk_device check {{(pid=87150) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Acquiring lock "cinder-792181b7-429f-4aa5-b63d-e4aeaf8c73eb-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:49 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 Sep 28 16:29:49 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "cinder-792181b7-429f-4aa5-b63d-e4aeaf8c73eb-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:49 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:49 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Acquiring lock "cinder-quobyte-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "cinder-quobyte-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720fe76-2863-4c32-b4ae-3557014d05f8]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:49 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb Sep 28 16:29:49 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:49 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:49 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:49 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Deleted volume successfully. Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6c7de982-d0bb-49db-9fff-8a39d19f64d4 tempest-ProjectReaderTests-16343667 None] Lock "cinder-c3113beb-c736-4363-a175-f549c9342270-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:50 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" returned: 0 in 0.678s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:50 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb Sep 28 16:29:50 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (3eedcd1a-4980-4519-a7fa-f497077d3504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:50 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ddeeaa-7009-4686-bd6e-d860b45381c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ddeeaa-7009-4686-bd6e-d860b45381c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380932617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9e13ca-5ee4-4625-93e0-b5ddb513610f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:51Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d797db17-85cf-4c97-9a68-b0973cdf35d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d797db17-85cf-4c97-9a68-b0973cdf35d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b559efe9-987f-4b77-995f-46c2be420979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b559efe9-987f-4b77-995f-46c2be420979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9e13ca-5ee4-4625-93e0-b5ddb513610f', 'volume_name': 'volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c56ea-ca88-410b-901e-43fe1fbdd213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:51 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067c56ea-ca88-410b-901e-43fe1fbdd213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db48c9c5-80f6-46cc-8f2c-ab91aa92f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:51 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Volume 5f9e13ca-5ee4-4625-93e0-b5ddb513610f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f', 'volume_size': 1} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" returned: 0 in 0.714s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "cinder-quobyte-792181b7-429f-4aa5-b63d-e4aeaf8c73eb" released by "delete_volume" :: held 1.494s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Created reservations ['29183b7c-09a8-4215-8326-d5576dacc61d', '959f6a7d-cb28-46eb-9799-cd659af6ed78', '1141c25f-a68e-4e2f-84d6-bbb7e0fd651b', '3803ab79-9bd0-4f4a-b973-b9a789b28c81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:51 devstack sudo[107789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:29:51 devstack sudo[107789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:52 devstack sudo[107789]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.747s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:52 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:29:52 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Deleted volume successfully. Sep 28 16:29:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-59c634ac-eaea-4401-813b-fd82526bc84e tempest-ProjectReaderTests-1243720405 None] Lock "cinder-792181b7-429f-4aa5-b63d-e4aeaf8c73eb-delete_volume" released by "delete_volume" :: held 2.809s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Flow 'volume_create_manager' (98912ccd-d053-47e6-9624-46fecbf45cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba85c1b-cef3-48d1-bbef-5e9f1f29191c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ba85c1b-cef3-48d1-bbef-5e9f1f29191c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714471385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fa05e0ba304928af2f5c9bc15c1609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:53Z,use_quota=True,user_id='442369d1ca3e490a8a3780a8107f8874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b138d9-086e-41a2-9889-fe36c8ee366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b138d9-086e-41a2-9889-fe36c8ee366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de09f1-a3fc-496a-91dc-e816e3fb983a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94de09f1-a3fc-496a-91dc-e816e3fb983a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2', 'volume_name': 'volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27042d0-9e42-4f5d-9fcd-db6147d43dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c27042d0-9e42-4f5d-9fcd-db6147d43dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054c3d44-0114-473b-b098-11e93f23fb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:53 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Volume 92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2', 'volume_size': 1} Sep 28 16:29:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:57 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5" returned: 0 in 7.750s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.image.image_utils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Image conversion details: src /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7, size 1024.00 MB, duration 7.75 sec, destination /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 {{(pid=87150) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 28 16:29:57 devstack cinder-volume[87150]: INFO cinder.image.image_utils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Converted 1024.00 MB image at 132.10 MB/s Sep 28 16:29:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 is being set with open permissions: ugo+rw Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:57 devstack sudo[107794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 Sep 28 16:29:57 devstack sudo[107794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:57 devstack sudo[107794]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" released by "_copy_volume_from_snapshot" :: held 9.034s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be-81da472e-05f2-4d87-8853-164b4be2fea5" released by "_create_volume_from_snapshot" :: held 9.110s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.147s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.425s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-380932617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9e13ca-5ee4-4625-93e0-b5ddb513610f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:51Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Creating volume 5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:57 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:57 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f 1073741824 Sep 28 16:29:57 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2982a7f2-c90a-41ff-acdb-04b2f2009c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81da472e-05f2-4d87-8853-164b4be2fea5', 'volume_size': 1, 'snapshot_id': 'f95c35ea-a89e-44eb-92ba-51cac2a069be'}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34a4803-debc-47b9-8053-1f4e872f5a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:57 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Volume volume-81da472e-05f2-4d87-8853-164b4be2fea5 (81da472e-05f2-4d87-8853-164b4be2fea5): created successfully Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b34a4803-debc-47b9-8053-1f4e872f5a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Flow 'volume_create_manager' (50852840-6518-49f3-954e-a1735308edaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:57 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-6be90563-0944-42d1-916b-21b59a73dab7 tempest-SnapshotDependencyTests-1857023687 None] Created volume successfully. Sep 28 16:29:57 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f 1073741824" returned: 0 in 0.436s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:58 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f Sep 28 16:29:58 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-f95c35ea-a89e-44eb-92ba-51cac2a069be-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-f95c35ea-a89e-44eb-92ba-51cac2a069be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:58 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.873s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1714471385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02fa05e0ba304928af2f5c9bc15c1609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:29:53Z,use_quota=True,user_id='442369d1ca3e490a8a3780a8107f8874',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Creating volume 92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:29:58 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Deleting offline snapshot f95c35ea-a89e-44eb-92ba-51cac2a069be of volume e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:29:58 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 1073741824 Sep 28 16:29:58 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] snapshot_file for this snap is: volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db48c9c5-80f6-46cc-8f2c-ab91aa92f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b921e-e4ce-4ef3-9476-39320f646eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[34243d47-dffe-4d3d-95cf-8d8d39a4d8e2]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:58 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Volume volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f (5f9e13ca-5ee4-4625-93e0-b5ddb513610f): created successfully Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad3b921e-e4ce-4ef3-9476-39320f646eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (3eedcd1a-4980-4519-a7fa-f497077d3504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2834e988-a622-43eb-9670-433e29564344 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:29:58 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:58 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:58 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 1073741824" returned: 0 in 0.462s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:58 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e641690f-d4aa-4d7e-996a-818169d371b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e211d2c-c245-412d-b54d-6a9be0fe403c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:58 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 Sep 28 16:29:58 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:58 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:29:58 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:59 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" returned: 0 in 0.252s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (054c3d44-0114-473b-b098-11e93f23fb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6617c5d-5b1f-4a8e-b294-ac7facf37a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:29:59 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Volume volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 (92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2): created successfully Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6617c5d-5b1f-4a8e-b294-ac7facf37a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Flow 'volume_create_manager' (98912ccd-d053-47e6-9624-46fecbf45cfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:29:59 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-93299e45-2106-46be-931b-81482c258113 tempest-ProjectReaderTests-1243720405 None] Created volume successfully. Sep 28 16:29:59 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.541s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:59 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:59 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Acquiring lock "cinder-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "cinder-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Acquiring lock "cinder-quobyte-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "cinder-quobyte-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[310a6ac8-d84c-450e-a5e0-ccbee524e607]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:59 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.434s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:29:59 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be Sep 28 16:29:59 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 3a947b07-2af5-4fd6-9609-11e45f9207d6 of volume 5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaec114-6ffb-461d-a218-1ff56acf8d4c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:29:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:29:59 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 Sep 28 16:29:59 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:29:59 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f Sep 28 16:29:59 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:00 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7.f95c35ea-a89e-44eb-92ba-51cac2a069be" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-f95c35ea-a89e-44eb-92ba-51cac2a069be" released by "_delete_snapshot" :: held 1.779s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" released by "delete_snapshot" :: held 1.835s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:00 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Created reservations ['287ab3c6-4c93-4aea-868b-4e0c48211095', '2479f9ff-ea3e-4a13-81d8-dac780d40a06', '83d5ad76-1c47-4cd6-8cef-5be788414e06', '00c3dc32-ad0c-4c62-8de7-e2f1da249dcf'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:00 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2 Sep 28 16:30:00 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:00 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:00 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Delete snapshot completed successfully. Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-c3c44fb6-cf80-4760-b918-ec49d1866058 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-f95c35ea-a89e-44eb-92ba-51cac2a069be-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:00 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 1G Sep 28 16:30:00 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-e641690f-d4aa-4d7e-996a-818169d371b7-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-e641690f-d4aa-4d7e-996a-818169d371b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:00 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" returned: 0 in 0.321s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "cinder-quobyte-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2" released by "delete_volume" :: held 0.779s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" acquired by "delete_volume" :: waited 0.034s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1685bd-8d06-4c0c-be4a-72244215a31f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Created reservations ['613205c7-7ed3-4c9f-9e01-bb7ecbdf79e8', 'dbd24af2-e028-4ae8-a726-5124412d6f2c', 'a9a8ea78-31c1-4650-b025-197c145623ec', '320da134-5aa0-445d-8a45-f9c81ac8420f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:00 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:30:00 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:00 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:00 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:00 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 1G" returned: 0 in 0.592s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:00 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 Sep 28 16:30:00 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.381s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:01 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.554s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Deleted volume successfully. Sep 28 16:30:01 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7 Sep 28 16:30:01 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b23529cc-7f1a-4ca6-9407-21b3d860cfe0 tempest-ProjectReaderTests-1243720405 None] Lock "cinder-92084dc0-7c2a-4f1d-9c81-d22e8bd7d5d2-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:01 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 is being set with open permissions: ugo+rw Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:01 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 Sep 28 16:30:01 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-e641690f-d4aa-4d7e-996a-818169d371b7" returned: 0 in 0.319s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-e641690f-d4aa-4d7e-996a-818169d371b7" released by "delete_volume" :: held 0.950s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Created reservations ['97743de6-743c-402b-983f-9c1b51babbf0', '74a0f523-5d00-4124-a933-1314bb4d0e9d', '7a78c4cc-002e-4d9e-a664-91a3fd76f6dc', '79a55157-0d23-471f-9e0e-381dcc67b6ab'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:01 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:01 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:01 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:01 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:01 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info" returned: 0 in 0.294s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info is being set with open permissions: ugo+rw Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:01 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:01 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info Sep 28 16:30:01 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Deleted volume successfully. Sep 28 16:30:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d79be791-1549-4bf8-88c9-436411b20057 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-e641690f-d4aa-4d7e-996a-818169d371b7-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:02 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.info" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:02 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fb0de625-2d0b-4ddf-a391-3e2f2b555a87 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-81da472e-05f2-4d87-8853-164b4be2fea5-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-81da472e-05f2-4d87-8853-164b4be2fea5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d9476-0977-4a50-95e3-c2559d4867d7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-3a947b07-2af5-4fd6-9609-11e45f9207d6-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:02 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 Sep 28 16:30:02 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-3a947b07-2af5-4fd6-9609-11e45f9207d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-3a947b07-2af5-4fd6-9609-11e45f9207d6" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-3a947b07-2af5-4fd6-9609-11e45f9207d6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 3a947b07-2af5-4fd6-9609-11e45f9207d6 of volume 5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[e708bce8-cfff-4689-80b1-0e65f6e9b9da]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:03 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 Sep 28 16:30:03 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:03 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5" returned: 0 in 0.421s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:03 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5 Sep 28 16:30:03 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:03 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6" returned: 0 in 0.399s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:03 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-81da472e-05f2-4d87-8853-164b4be2fea5" returned: 0 in 0.293s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a611eeff-c596-48a6-8823-0a5de9c0a404]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-quobyte-81da472e-05f2-4d87-8853-164b4be2fea5" released by "delete_volume" :: held 0.775s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Created reservations ['dea6c20a-343c-4e46-8213-9c35b7654d1e', '1eeb9b25-810d-4a01-abcb-3b4ba9420bc2', '24bdf00b-2e27-447d-958c-6abaef7bad49', 'b03cf77b-0092-447f-96fb-de80355e34cb'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:03 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f Sep 28 16:30:03 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:03 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:03 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:03 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:03 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" returned: 0 in 0.441s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Deleted volume successfully. Sep 28 16:30:04 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 Sep 28 16:30:04 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-4fd54111-c170-4a8c-9c08-78a61f082502 tempest-SnapshotDependencyTests-1857023687 None] Lock "cinder-81da472e-05f2-4d87-8853-164b4be2fea5-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:04 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:04 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6 Sep 28 16:30:04 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:04 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f.3a947b07-2af5-4fd6-9609-11e45f9207d6" returned: 0 in 0.285s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-3a947b07-2af5-4fd6-9609-11e45f9207d6" released by "_delete_snapshot" :: held 1.668s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" released by "delete_snapshot" :: held 1.706s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Created reservations ['97a360c2-bd29-4e01-89ad-3de546a0653d', '9efb33d6-7493-4f35-9480-4251630bc1c9', 'b189f65c-bcfc-4837-b97e-2b6fcb7a150d', 'cc79cbde-3893-4652-aa69-90dbc9359038'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:04 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:04 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-140718be-470b-4114-a1f7-d60a2968a783 tempest-ProjectMemberTests-255213367 None] Lock "cinder-3a947b07-2af5-4fd6-9609-11e45f9207d6-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-5f9e13ca-5ee4-4625-93e0-b5ddb513610f-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "cinder-5f9e13ca-5ee4-4625-93e0-b5ddb513610f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[970189f7-401c-4a78-b1bd-bbdd62f1e9af]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:05 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f Sep 28 16:30:05 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:05 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" returned: 0 in 0.413s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:05 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f Sep 28 16:30:05 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:05 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:05 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-5f9e13ca-5ee4-4625-93e0-b5ddb513610f" released by "delete_volume" :: held 0.745s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Created reservations ['e3c05f05-d079-4a95-88e8-b133d8aa1ac3', 'e6082517-17f8-44a7-a7f5-200570dee794', '517fabb2-a7f8-43f3-802c-51d29bcc762a', '2adf711b-ae8c-4bfc-92c6-82fe0ed66a0e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:06 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:06 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:06 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.277s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:06 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-df31d04f-963e-4392-9c7f-26662320230f tempest-ProjectMemberTests-255213367 None] Lock "cinder-5f9e13ca-5ee4-4625-93e0-b5ddb513610f-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (f9cc7299-e71f-432e-9105-14a7fefbe827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eeee40-0062-49f5-b85f-f186949e989d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7eeee40-0062-49f5-b85f-f186949e989d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269100617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711d0039-f345-4228-9136-349bc6cf70da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:07Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edef58f-b2d3-423f-a074-89250464855d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edef58f-b2d3-423f-a074-89250464855d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276929d6-0e9e-4287-8d3a-54f4206a747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (276929d6-0e9e-4287-8d3a-54f4206a747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711d0039-f345-4228-9136-349bc6cf70da', 'volume_name': 'volume-711d0039-f345-4228-9136-349bc6cf70da', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e153c16-99b2-466d-8e40-417dc4d6abf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e153c16-99b2-466d-8e40-417dc4d6abf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e838bd0b-e896-4e9d-bdc9-d928b78d17d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:06 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Volume 711d0039-f345-4228-9136-349bc6cf70da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711d0039-f345-4228-9136-349bc6cf70da', 'volume_size': 1} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1269100617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711d0039-f345-4228-9136-349bc6cf70da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:07Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Creating volume 711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:06 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:06 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:06 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da 1073741824 Sep 28 16:30:06 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:07 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da 1073741824" returned: 0 in 0.515s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:07 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da Sep 28 16:30:07 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:07 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e838bd0b-e896-4e9d-bdc9-d928b78d17d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711d0039-f345-4228-9136-349bc6cf70da', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0e9b6d-038a-45a8-8370-db4c98762205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:07 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Volume volume-711d0039-f345-4228-9136-349bc6cf70da (711d0039-f345-4228-9136-349bc6cf70da): created successfully Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0e9b6d-038a-45a8-8370-db4c98762205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:07 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (f9cc7299-e71f-432e-9105-14a7fefbe827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:07 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b0517051-4949-4502-97a5-f6101e6a48ed tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 3d1db786-8df4-4457-ba43-1586e0d5ac0d of volume 711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7788d-3788-42e4-a19b-79fd980632f7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:09 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da Sep 28 16:30:09 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:09 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da" returned: 0 in 0.414s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:09 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:09 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d 1G Sep 28 16:30:09 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:10 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d 1G" returned: 0 in 0.455s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711d0039-f345-4228-9136-349bc6cf70da -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:10 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711d0039-f345-4228-9136-349bc6cf70da -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d Sep 28 16:30:10 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:10 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-711d0039-f345-4228-9136-349bc6cf70da -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d is being set with open permissions: ugo+rw Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:10 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d Sep 28 16:30:10 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:10 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:10 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info Sep 28 16:30:10 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:10 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info" returned: 0 in 0.291s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:10 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info is being set with open permissions: ugo+rw Sep 28 16:30:10 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:10 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info Sep 28 16:30:10 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:11 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.info" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:11 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:11 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-2edb26b6-8bc3-40a1-8642-0056a0251fd5 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-3d1db786-8df4-4457-ba43-1586e0d5ac0d-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-3d1db786-8df4-4457-ba43-1586e0d5ac0d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-3d1db786-8df4-4457-ba43-1586e0d5ac0d" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-3d1db786-8df4-4457-ba43-1586e0d5ac0d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 3d1db786-8df4-4457-ba43-1586e0d5ac0d of volume 711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e3a5d6-9583-42e7-88c1-f6c61f5e780a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:12 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d Sep 28 16:30:12 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:12 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d" returned: 0 in 0.432s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-711d0039-f345-4228-9136-349bc6cf70da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[6decd846-fa73-4edb-a43f-1cea61497272]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:12 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:13 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da Sep 28 16:30:13 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:13 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da" returned: 0 in 0.499s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:13 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d Sep 28 16:30:13 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:13 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:13 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d Sep 28 16:30:13 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:14 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da.3d1db786-8df4-4457-ba43-1586e0d5ac0d" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-3d1db786-8df4-4457-ba43-1586e0d5ac0d" released by "_delete_snapshot" :: held 1.716s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" released by "delete_snapshot" :: held 1.744s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Created reservations ['c6d5bbad-f61b-4653-a311-254ff47f59e1', 'f2bc2910-16ac-476b-b478-10619baea200', '60af4547-4703-4527-92b6-3f74c644554f', '03955848-8662-4010-98f5-22fa1bf36361'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bcb7dfcf-8e55-4717-a0b0-a44cfd73fc37 tempest-ProjectMemberTests-255213367 None] Lock "cinder-3d1db786-8df4-4457-ba43-1586e0d5ac0d-delete_snapshot" released by "delete_snapshot" :: held 1.904s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-711d0039-f345-4228-9136-349bc6cf70da-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "cinder-711d0039-f345-4228-9136-349bc6cf70da-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ab95bd-f6de-420e-b219-9a22a98aec81]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:14 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da Sep 28 16:30:14 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:15 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:15 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da Sep 28 16:30:15 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:15 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-711d0039-f345-4228-9136-349bc6cf70da" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-711d0039-f345-4228-9136-349bc6cf70da" released by "delete_volume" :: held 0.756s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Created reservations ['f4765783-909d-4e59-ac50-d7325f710758', '57e095a9-06b6-463c-bed4-0e51a06d352f', '3d69904c-8aaf-4458-be4d-9f704c279f50', 'd1dc61b8-c8d9-45a6-97e7-60889a725873'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:15 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:15 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:15 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.265s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:15 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:15 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fa1a419c-5177-4db3-83c7-e88c89d75b3a tempest-ProjectMemberTests-255213367 None] Lock "cinder-711d0039-f345-4228-9136-349bc6cf70da-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (4dffadac-ddd5-4ece-aea9-9b53e7814bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44bba75-51ba-4ba9-a34e-0f63b63bc8af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44bba75-51ba-4ba9-a34e-0f63b63bc8af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33399058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c95ba1-6e7c-42b6-8fcb-93d2da419295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:16Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ea9fb6-e271-4442-93e9-689696213554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ea9fb6-e271-4442-93e9-689696213554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c270f-b563-4b9b-bb0b-f04a92275ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3c270f-b563-4b9b-bb0b-f04a92275ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c95ba1-6e7c-42b6-8fcb-93d2da419295', 'volume_name': 'volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714cd3be-575c-4e27-9584-928feb076ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (714cd3be-575c-4e27-9584-928feb076ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4082bf27-5546-4e9d-8e3b-f4748e74e1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:16 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Volume 96c95ba1-6e7c-42b6-8fcb-93d2da419295: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295', 'volume_size': 1} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33399058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c95ba1-6e7c-42b6-8fcb-93d2da419295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:16Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Creating volume 96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:16 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:16 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 1073741824 Sep 28 16:30:16 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:16 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 1073741824" returned: 0 in 0.459s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:16 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 Sep 28 16:30:16 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:16 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295" returned: 0 in 0.250s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4082bf27-5546-4e9d-8e3b-f4748e74e1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af93158-c664-4e2e-9b78-574de04283af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:17 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Volume volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 (96c95ba1-6e7c-42b6-8fcb-93d2da419295): created successfully Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af93158-c664-4e2e-9b78-574de04283af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (4dffadac-ddd5-4ece-aea9-9b53e7814bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:17 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ffd62c48-b0ef-4a2a-89ab-8bd948560c47 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot c34cc852-e907-4ac0-88c9-5a0f0a667b97 of volume 96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fe28cb-ea06-49ec-b6a1-d806c8b91def]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:17 devstack sudo[108048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 Sep 28 16:30:17 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:17 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:17 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 1G Sep 28 16:30:17 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:18 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 1G" returned: 0 in 0.417s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:18 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 Sep 28 16:30:18 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:18 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97" returned: 0 in 0.337s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:18 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 is being set with open permissions: ugo+rw Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:18 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 Sep 28 16:30:18 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:18 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:18 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info Sep 28 16:30:18 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:19 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:19 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info is being set with open permissions: ugo+rw Sep 28 16:30:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:19 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info Sep 28 16:30:19 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:19 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.info" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.049s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:19 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-20695dd8-975c-450d-aab2-1e2563327e16 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-c34cc852-e907-4ac0-88c9-5a0f0a667b97-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-c34cc852-e907-4ac0-88c9-5a0f0a667b97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-c34cc852-e907-4ac0-88c9-5a0f0a667b97" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-c34cc852-e907-4ac0-88c9-5a0f0a667b97" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot c34cc852-e907-4ac0-88c9-5a0f0a667b97 of volume 96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58088e5-5552-4e2a-9e46-72b183957432]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:20 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 Sep 28 16:30:20 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:21 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68e670c-5128-4a80-85e4-aa75720a5612]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:21 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 Sep 28 16:30:21 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:21 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295" returned: 0 in 0.382s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:21 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 Sep 28 16:30:21 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:21 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:21 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97 Sep 28 16:30:21 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:22 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295.c34cc852-e907-4ac0-88c9-5a0f0a667b97" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-c34cc852-e907-4ac0-88c9-5a0f0a667b97" released by "_delete_snapshot" :: held 1.506s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" released by "delete_snapshot" :: held 1.530s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=129,cinder:DELETE=20,cinder:UPDATE=188,cinder:INSERT=49 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=146,cinder:INSERT=44,cinder:UPDATE=178,cinder:DELETE=12 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Created reservations ['564b1287-a6dd-4e74-b66c-dd2e2eed53a6', '7329f74e-32ba-4c0f-91a4-84254436e19a', '419b9c58-bb6b-4631-a91a-23890ee6aebb', '08835bc9-7e20-4902-a76b-23d134f9ca9f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:22 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-b3ebb3a3-1de0-4b3d-a93e-f176ef47900d tempest-ProjectMemberTests-255213367 None] Lock "cinder-c34cc852-e907-4ac0-88c9-5a0f0a667b97-delete_snapshot" released by "delete_snapshot" :: held 1.683s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-96c95ba1-6e7c-42b6-8fcb-93d2da419295-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "cinder-96c95ba1-6e7c-42b6-8fcb-93d2da419295-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c8ec45-831d-4a91-a537-d250a9352f39]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:22 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 Sep 28 16:30:22 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:23 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295" returned: 0 in 0.386s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:23 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295 Sep 28 16:30:23 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:23 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-96c95ba1-6e7c-42b6-8fcb-93d2da419295" returned: 0 in 0.249s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-96c95ba1-6e7c-42b6-8fcb-93d2da419295" released by "delete_volume" :: held 0.698s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Created reservations ['1b9a26eb-274d-4b23-b46c-991756b234a7', 'eb4519fd-ce41-4334-9ed3-e22a04893c50', 'b0d48c16-a0fe-4dab-a4c1-e8bfd5ea1b5c', '992c79be-9dcb-402c-a939-0b78d5bbae6b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:23 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:23 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:23 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:23 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:23 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1ff4149a-17c4-4e24-8279-d2bc64e59513 tempest-ProjectMemberTests-255213367 None] Lock "cinder-96c95ba1-6e7c-42b6-8fcb-93d2da419295-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (f97efe78-521e-40ed-8f37-03625bfd0efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c06bcc7-d0f4-4779-bba4-3e472b792747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c06bcc7-d0f4-4779-bba4-3e472b792747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241415645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba85eb4e-b245-44f5-ba45-4fe43afd7c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:24Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6539eabe-3a8e-462a-997e-6fdc60d27da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6539eabe-3a8e-462a-997e-6fdc60d27da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144829f-b17f-4662-be8d-65c7035092cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5144829f-b17f-4662-be8d-65c7035092cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba85eb4e-b245-44f5-ba45-4fe43afd7c9e', 'volume_name': 'volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a55541-33f4-4fea-a08e-9fdb0d3b3d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37a55541-33f4-4fea-a08e-9fdb0d3b3d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c60389-7070-4fed-997d-353b671a0cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:24 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Volume ba85eb4e-b245-44f5-ba45-4fe43afd7c9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e', 'volume_size': 1} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-241415645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba85eb4e-b245-44f5-ba45-4fe43afd7c9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:24Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Creating volume ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:24 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:24 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e 1073741824 Sep 28 16:30:24 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:24 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e 1073741824" returned: 0 in 0.463s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:24 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e Sep 28 16:30:24 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:25 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56c60389-7070-4fed-997d-353b671a0cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be690324-560e-4d39-8521-a98d4dfcf674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:25 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Volume volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e (ba85eb4e-b245-44f5-ba45-4fe43afd7c9e): created successfully Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be690324-560e-4d39-8521-a98d4dfcf674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (f97efe78-521e-40ed-8f37-03625bfd0efa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:25 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3d52c2c2-23ea-490a-af06-8df68424bbce tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Creating offline snapshot ba84c501-e942-4303-943a-57ffea3ac73f of volume ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a18e5eb-49f2-4ba2-ac6e-a7ed0d922ffd]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:25 devstack sudo[108109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e Sep 28 16:30:25 devstack sudo[108109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:25 devstack sudo[108109]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:25 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f 1G Sep 28 16:30:25 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:26 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f 1G" returned: 0 in 0.408s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:26 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f Sep 28 16:30:26 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:26 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f" returned: 0 in 0.308s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:26 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f is being set with open permissions: ugo+rw Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:26 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f Sep 28 16:30:26 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:26 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:26 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info Sep 28 16:30:26 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:27 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:27 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info is being set with open permissions: ugo+rw Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:27 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info Sep 28 16:30:27 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:27 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.info" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.992s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:27 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-33f6ecca-75a7-4370-9981-2ca48df737cb tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-ba84c501-e942-4303-943a-57ffea3ac73f-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-ba84c501-e942-4303-943a-57ffea3ac73f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-ba84c501-e942-4303-943a-57ffea3ac73f" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba84c501-e942-4303-943a-57ffea3ac73f" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot ba84c501-e942-4303-943a-57ffea3ac73f of volume ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[88dcdbfe-e8cb-4559-9ecd-538853815a2f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:27 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f Sep 28 16:30:27 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:28 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f" returned: 0 in 0.412s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518f963-44f8-4626-883c-25aefbab7a4e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:28 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e Sep 28 16:30:28 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:28 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:28 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f Sep 28 16:30:28 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:28 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f" returned: 0 in 0.355s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:28 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f Sep 28 16:30:28 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:29 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e.ba84c501-e942-4303-943a-57ffea3ac73f" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba84c501-e942-4303-943a-57ffea3ac73f" released by "_delete_snapshot" :: held 1.538s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" released by "delete_snapshot" :: held 1.562s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Created reservations ['ef52998c-c181-4013-9f06-63208c28faab', 'd610cef0-33ea-45dc-a203-024c35d18747', '27114e9f-9e67-4702-bab3-62d750f78833', 'b211a78e-008a-4f34-9460-3cd8eb28dc7b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-7ad8bdf1-89d9-4a1e-a556-70c3998be8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-ba84c501-e942-4303-943a-57ffea3ac73f-delete_snapshot" released by "delete_snapshot" :: held 1.721s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "cinder-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7aa666c-03e4-4f40-bbed-03309e9fdbba]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:30 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e Sep 28 16:30:30 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:30 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:30 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e Sep 28 16:30:30 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:30 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e" released by "delete_volume" :: held 0.718s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Created reservations ['eeef9c00-720f-4cc5-afc3-29af4a655e7a', '33ce5dfe-b581-4639-b63e-c791726773db', '416af8a1-5874-4f05-93d8-05f9c732a51a', 'c52f2bb2-813b-42f1-a2b8-bc2852ccb7c5'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:30 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:30 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:31 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:31 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-0b805f60-daff-4daf-9b5b-0bb35365c876 tempest-ProjectMemberTests-255213367 None] Lock "cinder-ba85eb4e-b245-44f5-ba45-4fe43afd7c9e-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (e59d9cf1-cd2e-49c4-a593-e14df01c76b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092993b4-c389-475a-bec5-70e2c8b59f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092993b4-c389-475a-bec5-70e2c8b59f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919763951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6330a146-d80d-476c-a486-eda23e30f756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:31Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136f59ac-40c3-488e-9019-863894aafb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (136f59ac-40c3-488e-9019-863894aafb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c3ed97-19d2-47a9-9b5d-2689dc021c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c3ed97-19d2-47a9-9b5d-2689dc021c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6330a146-d80d-476c-a486-eda23e30f756', 'volume_name': 'volume-6330a146-d80d-476c-a486-eda23e30f756', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab99f79c-ea87-4cb8-bf78-d44917831ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab99f79c-ea87-4cb8-bf78-d44917831ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd33b8d8-a441-4ebc-8482-17a23530aa44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:31 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Volume 6330a146-d80d-476c-a486-eda23e30f756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6330a146-d80d-476c-a486-eda23e30f756', 'volume_size': 1} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-919763951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6330a146-d80d-476c-a486-eda23e30f756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:31Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Creating volume 6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:31 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:31 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 1073741824 Sep 28 16:30:31 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:32 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 1073741824" returned: 0 in 0.411s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:32 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 Sep 28 16:30:32 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:32 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756" returned: 0 in 0.261s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd33b8d8-a441-4ebc-8482-17a23530aa44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6330a146-d80d-476c-a486-eda23e30f756', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a3151-8f26-424a-b7a9-13aac90110f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:32 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Volume volume-6330a146-d80d-476c-a486-eda23e30f756 (6330a146-d80d-476c-a486-eda23e30f756): created successfully Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221a3151-8f26-424a-b7a9-13aac90110f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:32 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (e59d9cf1-cd2e-49c4-a593-e14df01c76b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-39836b36-9466-4af4-8458-3188e35d9ae0 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:33 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 2d224de2-937e-4551-bc5c-afce48f6a0f9 of volume 6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:33 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f8f102-af70-4170-b183-7c0be423324b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:33 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 Sep 28 16:30:33 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:34 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756" returned: 0 in 0.376s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:34 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 1G Sep 28 16:30:34 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:34 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 1G" returned: 0 in 0.409s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6330a146-d80d-476c-a486-eda23e30f756 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:34 devstack sudo[108184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6330a146-d80d-476c-a486-eda23e30f756 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 Sep 28 16:30:34 devstack sudo[108184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:34 devstack sudo[108184]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6330a146-d80d-476c-a486-eda23e30f756 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9" returned: 0 in 0.296s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:34 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 is being set with open permissions: ugo+rw Sep 28 16:30:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:34 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 Sep 28 16:30:34 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:35 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9" returned: 0 in 0.238s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:35 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info Sep 28 16:30:35 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:35 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:35 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info is being set with open permissions: ugo+rw Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:35 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info Sep 28 16:30:35 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:35 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.info" returned: 0 in 0.239s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-00e202c1-e946-4ee2-a822-cc14e4247a91 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-2d224de2-937e-4551-bc5c-afce48f6a0f9-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-2d224de2-937e-4551-bc5c-afce48f6a0f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-2d224de2-937e-4551-bc5c-afce48f6a0f9" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-2d224de2-937e-4551-bc5c-afce48f6a0f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 2d224de2-937e-4551-bc5c-afce48f6a0f9 of volume 6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6a7fa7-9118-420f-84e3-3665c96f9a8c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:36 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 Sep 28 16:30:36 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:36 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9" returned: 0 in 0.375s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6330a146-d80d-476c-a486-eda23e30f756(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd510c7-b7bd-4372-aa21-fc0f75424b85]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:36 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 Sep 28 16:30:36 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:36 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:36 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:36 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756" returned: 0 in 0.368s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:36 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:36 devstack sudo[108211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 Sep 28 16:30:36 devstack sudo[108211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:30:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:30:37 devstack sudo[108211]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9" returned: 0 in 0.340s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:37 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9 Sep 28 16:30:37 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:37 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756.2d224de2-937e-4551-bc5c-afce48f6a0f9" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-2d224de2-937e-4551-bc5c-afce48f6a0f9" released by "_delete_snapshot" :: held 1.463s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" released by "delete_snapshot" :: held 1.490s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Created reservations ['176adff1-f19e-4ee9-b00d-cef04fe08ad1', '2367321a-3e74-444a-a56f-4335aef050de', '7a6fa222-e6e8-44ce-b89a-202bdfa9f0d7', '579a4f51-0b5a-44fc-a719-11a4cce25f38'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:37 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-bbd883cc-d71c-42f8-ae32-b08cfbf2d8a2 tempest-ProjectMemberTests-255213367 None] Lock "cinder-2d224de2-937e-4551-bc5c-afce48f6a0f9-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-6330a146-d80d-476c-a486-eda23e30f756-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "cinder-6330a146-d80d-476c-a486-eda23e30f756-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d1b05a-0311-4f7f-bcb2-4464cc742a4e]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:38 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 Sep 28 16:30:38 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:38 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:38 devstack sudo[108225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756 Sep 28 16:30:38 devstack sudo[108225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:38 devstack sudo[108225]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6330a146-d80d-476c-a486-eda23e30f756" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6330a146-d80d-476c-a486-eda23e30f756" released by "delete_volume" :: held 0.673s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Created reservations ['835a9c0b-bdde-48fd-9bd7-0d670828bd45', '1b52895c-abcc-4fe9-b005-43d6b74cabe9', '93cffe56-acd6-4ac8-99b6-d42340f77dea', '8e6fad13-7fea-41de-a095-f2cb87e78a21'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:38 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:38 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:39 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-a12f620d-c9b8-456f-a024-12f78841781c tempest-ProjectMemberTests-255213367 None] Lock "cinder-6330a146-d80d-476c-a486-eda23e30f756-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (b44b468f-918a-4c8a-92c8-5b0d63ba3536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa27882-7b29-40d4-9735-f7d39e6c6f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fa27882-7b29-40d4-9735-f7d39e6c6f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549134512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66f926-842a-4ea3-ac24-6f5e48b1bb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:40Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5728d3-c40b-4060-8137-3b9033d600b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5728d3-c40b-4060-8137-3b9033d600b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfebe54-3af0-411d-9083-99336b0c0e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecfebe54-3af0-411d-9083-99336b0c0e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a66f926-842a-4ea3-ac24-6f5e48b1bb0a', 'volume_name': 'volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de2f98c-50ea-4856-83fe-575f8bbdb8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1de2f98c-50ea-4856-83fe-575f8bbdb8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81940c1-6ef2-4ff1-b2af-2795803155a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:39 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Volume 1a66f926-842a-4ea3-ac24-6f5e48b1bb0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a', 'volume_size': 1} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549134512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a66f926-842a-4ea3-ac24-6f5e48b1bb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:40Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Creating volume 1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:39 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:39 devstack sudo[108231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a 1073741824 Sep 28 16:30:39 devstack sudo[108231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:40 devstack sudo[108231]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a 1073741824" returned: 0 in 0.397s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:40 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a Sep 28 16:30:40 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:40 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f81940c1-6ef2-4ff1-b2af-2795803155a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd0565-3492-4076-ab22-d1a4075039a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:40 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Volume volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a (1a66f926-842a-4ea3-ac24-6f5e48b1bb0a): created successfully Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ddd0565-3492-4076-ab22-d1a4075039a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (b44b468f-918a-4c8a-92c8-5b0d63ba3536) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:40 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-736b62b3-d2aa-45ae-8050-3389a10d1150 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot a21c4752-50e7-4169-b46a-06e04feb01f2 of volume 1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ade0895-a299-4e4e-b6b8-f78e0d9eab9d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:41 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a Sep 28 16:30:41 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:41 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" returned: 0 in 0.377s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:41 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 1G Sep 28 16:30:41 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:41 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 1G" returned: 0 in 0.407s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:41 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 Sep 28 16:30:41 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:41 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2" returned: 0 in 0.303s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:42 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 is being set with open permissions: ugo+rw Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:42 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 Sep 28 16:30:42 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:42 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:42 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info Sep 28 16:30:42 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:42 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:42 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info is being set with open permissions: ugo+rw Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:42 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info Sep 28 16:30:42 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:42 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.info" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-0e3d8841-3811-4f03-9ddf-08e30d05f6b9 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-a21c4752-50e7-4169-b46a-06e04feb01f2-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-a21c4752-50e7-4169-b46a-06e04feb01f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-a21c4752-50e7-4169-b46a-06e04feb01f2" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a21c4752-50e7-4169-b46a-06e04feb01f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot a21c4752-50e7-4169-b46a-06e04feb01f2 of volume 1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0735f7d-af8e-4479-ab9b-58f08456bf67]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:43 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 Sep 28 16:30:43 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:43 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2" returned: 0 in 0.349s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c76a422-7f51-4a1c-8fd5-78fb36ca324d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:43 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a Sep 28 16:30:43 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:43 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" returned: 0 in 0.342s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:43 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 Sep 28 16:30:43 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:44 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2" returned: 0 in 0.323s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:44 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2 Sep 28 16:30:44 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:44 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a.a21c4752-50e7-4169-b46a-06e04feb01f2" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-a21c4752-50e7-4169-b46a-06e04feb01f2" released by "_delete_snapshot" :: held 1.363s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" released by "delete_snapshot" :: held 1.388s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Created reservations ['a0df5191-2d02-4994-9980-5c65f33c1352', '81cf2582-18e4-4d73-988c-042bd1ec8e9b', '06b55d4f-2b01-4434-b3ca-2c8e7e066d6b', '7100ed9a-8268-4742-8b6a-73808e98a47f'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:44 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-1499e342-ed6e-4b64-8790-3459f10fa4e6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-a21c4752-50e7-4169-b46a-06e04feb01f2-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" acquired by "delete_volume" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8a6ee-8342-4319-8b55-2576091ba6b5]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:45 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a Sep 28 16:30:45 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:45 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:45 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a Sep 28 16:30:45 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:45 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" returned: 0 in 0.247s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:45 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a" released by "delete_volume" :: held 0.687s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Created reservations ['5449f2c3-db1b-4347-945a-00cbd5a2e547', '8d3591bb-da2d-4225-9544-cce0f63d151f', '43bdf7a2-1249-42d3-97f9-4880df01bee5', '8b9a7bec-eacb-4195-a04f-8fe9e1aae797'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:46 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:46 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:46 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.275s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d0a04ab7-d308-4a71-835a-f844c49b07f6 tempest-ProjectMemberTests-255213367 None] Lock "cinder-1a66f926-842a-4ea3-ac24-6f5e48b1bb0a-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (875f9af7-c8a1-4c41-8d76-d48b81cd2bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da710a7-817a-4c07-abe7-706a187f6b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da710a7-817a-4c07-abe7-706a187f6b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674300035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e439771-8d22-4f54-a5a9-ea5cee9f226d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:47Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde38128-4b9b-4a94-8dee-4748193a258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde38128-4b9b-4a94-8dee-4748193a258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee5439-4233-4a99-956e-5c2cd80ebdd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee5439-4233-4a99-956e-5c2cd80ebdd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e439771-8d22-4f54-a5a9-ea5cee9f226d', 'volume_name': 'volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e3166b-f8d2-475c-8ac0-835717bab8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e3166b-f8d2-475c-8ac0-835717bab8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b494ba2a-51b0-4b24-8427-10bb21dc3d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:46 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Volume 6e439771-8d22-4f54-a5a9-ea5cee9f226d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d', 'volume_size': 1} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-674300035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e439771-8d22-4f54-a5a9-ea5cee9f226d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:47Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Creating volume 6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:46 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:46 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d 1073741824 Sep 28 16:30:46 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:47 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d 1073741824" returned: 0 in 0.439s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:47 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d Sep 28 16:30:47 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:47 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b494ba2a-51b0-4b24-8427-10bb21dc3d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd12870-675a-497a-b019-58d2978e16e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:47 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Volume volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d (6e439771-8d22-4f54-a5a9-ea5cee9f226d): created successfully Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd12870-675a-497a-b019-58d2978e16e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:47 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (875f9af7-c8a1-4c41-8d76-d48b81cd2bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:47 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-69820bb8-ea94-4e3a-8254-69ee77e9be64 tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 10261433-7f08-4276-ae22-9cc388053d90 of volume 6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a7bce-23ce-4a50-a505-3ae84d4486fb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:48 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d Sep 28 16:30:48 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:48 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d" returned: 0 in 0.380s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:48 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 1G Sep 28 16:30:48 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:48 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 1G" returned: 0 in 0.396s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:48 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 Sep 28 16:30:48 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:49 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90" returned: 0 in 0.292s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:49 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 is being set with open permissions: ugo+rw Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:49 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 Sep 28 16:30:49 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:49 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:49 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info Sep 28 16:30:49 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:49 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info" returned: 0 in 0.263s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:49 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info is being set with open permissions: ugo+rw Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:49 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info Sep 28 16:30:49 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:49 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.info" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-aec6f716-6289-44f9-adca-5364a4124279 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-10261433-7f08-4276-ae22-9cc388053d90-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-10261433-7f08-4276-ae22-9cc388053d90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-10261433-7f08-4276-ae22-9cc388053d90" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-10261433-7f08-4276-ae22-9cc388053d90" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 10261433-7f08-4276-ae22-9cc388053d90 of volume 6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[540fcc10-d979-4c58-864f-25c1ac6963c7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:50 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 Sep 28 16:30:50 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:50 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90" returned: 0 in 0.392s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[036cf792-b334-417a-b781-6d16a71d8aa7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:50 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d Sep 28 16:30:50 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:51 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d" returned: 0 in 0.388s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:51 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 Sep 28 16:30:51 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:51 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90" returned: 0 in 0.344s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:51 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90 Sep 28 16:30:51 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:51 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d.10261433-7f08-4276-ae22-9cc388053d90" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-10261433-7f08-4276-ae22-9cc388053d90" released by "_delete_snapshot" :: held 1.494s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" released by "delete_snapshot" :: held 1.521s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Created reservations ['010e638b-37b5-4a8c-8f82-bc7375739598', '204ce1fa-7a33-4481-b9fc-0804dd765206', '8dcc9be6-c5c3-40d3-80d3-ab1e1563a17c', '119fae5f-841b-4a73-b3cb-730217756724'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:51 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:30:51 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-34eb4c15-b2a6-4ef0-9004-7aa823682ec0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-10261433-7f08-4276-ae22-9cc388053d90-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-6e439771-8d22-4f54-a5a9-ea5cee9f226d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "cinder-6e439771-8d22-4f54-a5a9-ea5cee9f226d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[635050fd-d88c-473b-a695-73d089ea2128]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:52 devstack sudo[108347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d Sep 28 16:30:52 devstack sudo[108347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:52 devstack sudo[108347]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d" returned: 0 in 0.358s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:52 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:52 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d Sep 28 16:30:52 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:53 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-6e439771-8d22-4f54-a5a9-ea5cee9f226d" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-6e439771-8d22-4f54-a5a9-ea5cee9f226d" released by "delete_volume" :: held 0.690s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Created reservations ['13d7b424-b3fb-46a0-884b-04ddcb723f65', '059235ec-c876-4373-8077-3d27fb999f39', '63cabe10-0f6e-4fef-b281-7372ee736ba4', '3451aa55-e6a2-4625-aaff-448e92b6375b'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:53 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:30:53 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:53 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:30:53 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:30:53 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-542440e3-cb9b-46c9-b13d-d11bbf1c92d3 tempest-ProjectMemberTests-255213367 None] Lock "cinder-6e439771-8d22-4f54-a5a9-ea5cee9f226d-delete_volume" released by "delete_volume" :: held 1.197s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (8f60e12d-b084-46d3-aed7-c31fc2c15123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d758998-137f-4f83-adc5-49d820300395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d758998-137f-4f83-adc5-49d820300395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094612168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214e5629-6ff2-49af-9b82-80df34d17fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:54Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3affecb-c7cd-4259-83a4-1ef772229583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3affecb-c7cd-4259-83a4-1ef772229583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c3f6c-1c30-486f-9f53-4e900b13cdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b19c3f6c-1c30-486f-9f53-4e900b13cdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214e5629-6ff2-49af-9b82-80df34d17fdd', 'volume_name': 'volume-214e5629-6ff2-49af-9b82-80df34d17fdd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f365d4ee-a442-44e5-935e-7c80c83a0991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f365d4ee-a442-44e5-935e-7c80c83a0991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d764e9-309e-459c-b2b2-bd0ae34f0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Volume 214e5629-6ff2-49af-9b82-80df34d17fdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214e5629-6ff2-49af-9b82-80df34d17fdd', 'volume_size': 1} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:30:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1094612168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214e5629-6ff2-49af-9b82-80df34d17fdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f82d12d182fd4f0b98c46ebb222e2d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:30:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:30:54Z,use_quota=True,user_id='3957557bbb4f44f0a437305f6fc53871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Creating volume 214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:30:54 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:54 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd 1073741824 Sep 28 16:30:54 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:54 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd 1073741824" returned: 0 in 0.419s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:54 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd Sep 28 16:30:54 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:54 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44d764e9-309e-459c-b2b2-bd0ae34f0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214e5629-6ff2-49af-9b82-80df34d17fdd', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d4e6b2-0a42-47e3-b9b0-28550b4e60ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:30:54 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Volume volume-214e5629-6ff2-49af-9b82-80df34d17fdd (214e5629-6ff2-49af-9b82-80df34d17fdd): created successfully Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d4e6b2-0a42-47e3-b9b0-28550b4e60ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:30:54 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Flow 'volume_create_manager' (8f60e12d-b084-46d3-aed7-c31fc2c15123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:30:54 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-36495f93-7491-49d3-998e-6ce2f1f7304f tempest-ProjectMemberTests-255213367 None] Created volume successfully. Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Creating offline snapshot 307d11db-bbc4-4d4c-867f-e3673ba6077a of volume 214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfc7566-d78e-47a8-bd98-05b763146a1a]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:56 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd Sep 28 16:30:56 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:56 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:56 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:56 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a 1G Sep 28 16:30:56 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:57 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a 1G" returned: 0 in 0.425s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214e5629-6ff2-49af-9b82-80df34d17fdd -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:57 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214e5629-6ff2-49af-9b82-80df34d17fdd -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a Sep 28 16:30:57 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:57 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-214e5629-6ff2-49af-9b82-80df34d17fdd -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a" returned: 0 in 0.309s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:57 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a is being set with open permissions: ugo+rw Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:57 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a Sep 28 16:30:57 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:57 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:57 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:57 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info Sep 28 16:30:57 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:58 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info" returned: 0 in 0.289s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:58 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info is being set with open permissions: ugo+rw Sep 28 16:30:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:58 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info Sep 28 16:30:58 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:30:58 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 28 16:30:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.info" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:30:58 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.014s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:30:58 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3f4076bc-ea47-48b4-ae0c-b36467dcbc15 tempest-ProjectMemberTests-255213367 None] Create snapshot completed successfully Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-307d11db-bbc4-4d4c-867f-e3673ba6077a-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-307d11db-bbc4-4d4c-867f-e3673ba6077a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-307d11db-bbc4-4d4c-867f-e3673ba6077a" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-307d11db-bbc4-4d4c-867f-e3673ba6077a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Deleting offline snapshot 307d11db-bbc4-4d4c-867f-e3673ba6077a of volume 214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] snapshot_file for this snap is: volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[332dec1d-d548-4502-8a40-a9e789e28ab1]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:30:59 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:30:59 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a Sep 28 16:30:59 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:00 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a" returned: 0 in 0.374s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-214e5629-6ff2-49af-9b82-80df34d17fdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ad0d73-0af8-40b0-ad26-685d3c6a953b]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:00 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd Sep 28 16:31:00 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:00 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:00 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a Sep 28 16:31:00 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:00 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a" returned: 0 in 0.359s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:00 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:00 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a Sep 28 16:31:00 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:01 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd.307d11db-bbc4-4d4c-867f-e3673ba6077a" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-307d11db-bbc4-4d4c-867f-e3673ba6077a" released by "_delete_snapshot" :: held 1.458s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" released by "delete_snapshot" :: held 1.480s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Created reservations ['98b9e53c-22ea-46f4-af85-5fefe86d39b6', '5866a2a9-38c7-4a73-b830-ec52f2cbec31', '87ddf36f-b633-4869-8a6f-f6a95b7208b6', '85c5184e-e015-40e6-b62b-f228d41bfe6e'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:01 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Delete snapshot completed successfully. Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-3462bbc3-f2d7-40e4-aac8-07ad567da861 tempest-ProjectMemberTests-255213367 None] Lock "cinder-307d11db-bbc4-4d4c-867f-e3673ba6077a-delete_snapshot" released by "delete_snapshot" :: held 1.624s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-214e5629-6ff2-49af-9b82-80df34d17fdd-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-214e5629-6ff2-49af-9b82-80df34d17fdd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b8999c-7e28-4eb0-a010-cd0e9461c023]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:01 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:02 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd Sep 28 16:31:02 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:02 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd" returned: 0 in 0.423s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:02 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd Sep 28 16:31:02 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:02 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-214e5629-6ff2-49af-9b82-80df34d17fdd" returned: 0 in 0.258s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-quobyte-214e5629-6ff2-49af-9b82-80df34d17fdd" released by "delete_volume" :: held 0.751s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Created reservations ['b37f2538-aaa4-4a6f-8cd9-e3cacf55b6fe', '2bdba6ae-62fb-4444-ab8a-8facca353b36', '3f3c6957-59f0-49a4-a77b-fe0c7493333f', '86ac925b-a58f-4e3e-97f6-5fc975d8dddd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:02 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:02 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:02 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:03 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:03 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:03 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:03 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Deleted volume successfully. Sep 28 16:31:03 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-122639fc-0fe9-4f40-882a-7862cd45a6f0 tempest-ProjectMemberTests-255213367 None] Lock "cinder-214e5629-6ff2-49af-9b82-80df34d17fdd-delete_volume" released by "delete_volume" :: held 1.252s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:12 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=83,cinder:INSERT=29,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=74,cinder:INSERT=29,cinder:UPDATE=112,cinder:DELETE=8 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (7946a2f3-d05b-4ec9-a8e6-b2ba8cc351f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2964fdd1-0f00-4b40-bc48-e0ab1126d62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2964fdd1-0f00-4b40-bc48-e0ab1126d62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745634448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49614789-e1bc-4138-b22d-744f99aae410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:13Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26031ea-91ee-4caa-b4ab-d8789579af48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b26031ea-91ee-4caa-b4ab-d8789579af48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57166bb6-ad6a-41cb-8c2a-a12a9cd81d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57166bb6-ad6a-41cb-8c2a-a12a9cd81d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49614789-e1bc-4138-b22d-744f99aae410', 'volume_name': 'volume-49614789-e1bc-4138-b22d-744f99aae410', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b5e5b4-8fc3-4e67-95ad-1e2397127fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b5e5b4-8fc3-4e67-95ad-1e2397127fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3ab36b-debe-4794-91f6-cc2252a76a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:13 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Volume 49614789-e1bc-4138-b22d-744f99aae410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49614789-e1bc-4138-b22d-744f99aae410', 'volume_size': 1} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1745634448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49614789-e1bc-4138-b22d-744f99aae410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:13Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Creating volume 49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:31:13 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:13 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 1073741824 Sep 28 16:31:13 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:13 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 1073741824" returned: 0 in 0.450s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:13 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:13 devstack sudo[108475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 Sep 28 16:31:13 devstack sudo[108475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:14 devstack sudo[108475]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410" returned: 0 in 0.260s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b3ab36b-debe-4794-91f6-cc2252a76a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49614789-e1bc-4138-b22d-744f99aae410', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8478da2-1231-49ca-a08a-4eef6e5f2695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:14 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Volume volume-49614789-e1bc-4138-b22d-744f99aae410 (49614789-e1bc-4138-b22d-744f99aae410): created successfully Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8478da2-1231-49ca-a08a-4eef6e5f2695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (7946a2f3-d05b-4ec9-a8e6-b2ba8cc351f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:14 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-347f9f63-53ec-4d98-9fbf-2b5df820fc0c tempest-ProjectReaderTests-437891029 None] Created volume successfully. Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Creating offline snapshot f309118d-5238-466b-9953-f27107645992 of volume 49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b38e45-1bce-43f5-89be-1b24100eb9d9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:14 devstack sudo[108478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 Sep 28 16:31:14 devstack sudo[108478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:14 devstack sudo[108478]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:14 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:14 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 1G Sep 28 16:31:14 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:15 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 1G" returned: 0 in 0.428s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49614789-e1bc-4138-b22d-744f99aae410 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:15 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49614789-e1bc-4138-b22d-744f99aae410 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 Sep 28 16:31:15 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:15 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49614789-e1bc-4138-b22d-744f99aae410 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992" returned: 0 in 0.306s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:15 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 is being set with open permissions: ugo+rw Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:15 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 Sep 28 16:31:15 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:15 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992" returned: 0 in 0.272s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:15 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:15 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info Sep 28 16:31:15 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:16 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:16 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info is being set with open permissions: ugo+rw Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:16 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info Sep 28 16:31:16 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:16 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.info" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:16 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-b6f705da-fc35-4a60-85b5-d5cdb2d86013 tempest-ProjectReaderTests-437891029 None] Create snapshot completed successfully Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-f309118d-5238-466b-9953-f27107645992-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-f309118d-5238-466b-9953-f27107645992-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-f309118d-5238-466b-9953-f27107645992" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f309118d-5238-466b-9953-f27107645992" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Deleting offline snapshot f309118d-5238-466b-9953-f27107645992 of volume 49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] snapshot_file for this snap is: volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a071a5-2722-4c66-9131-590ad0799bd0]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:16 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:16 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 Sep 28 16:31:16 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:17 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49614789-e1bc-4138-b22d-744f99aae410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c984390a-d5e5-4471-b17d-960d294b679c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:17 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 Sep 28 16:31:17 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:17 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410" returned: 0 in 0.410s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:17 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:17 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 Sep 28 16:31:17 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:18 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992" returned: 0 in 0.359s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:18 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992 Sep 28 16:31:18 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:18 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410.f309118d-5238-466b-9953-f27107645992" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f309118d-5238-466b-9953-f27107645992" released by "_delete_snapshot" :: held 1.522s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" released by "delete_snapshot" :: held 1.554s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Created reservations ['836fcb92-2e6e-4b36-a3c3-613c73846d2c', '153e8631-314a-4f82-a30a-f7717f6822c4', '16d4bda1-cbb0-495f-96f7-b0984a845786', '6bac24fc-c6b1-4350-8a5b-ede95cfbde81'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:18 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Delete snapshot completed successfully. Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-ab332672-ab23-4dc3-ad46-9289c517a61b tempest-ProjectReaderTests-437891029 None] Lock "cinder-f309118d-5238-466b-9953-f27107645992-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-49614789-e1bc-4138-b22d-744f99aae410-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "cinder-49614789-e1bc-4138-b22d-744f99aae410-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:18 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[069176fd-650b-4c38-a902-5b7144968658]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:19 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 Sep 28 16:31:19 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:19 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:19 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410 Sep 28 16:31:19 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:19 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-49614789-e1bc-4138-b22d-744f99aae410" returned: 0 in 0.283s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-49614789-e1bc-4138-b22d-744f99aae410" released by "delete_volume" :: held 0.750s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Created reservations ['9ba35543-d84d-454f-9704-6bc75f0f044c', '47a1bb08-e4ff-451b-9961-8fb903a5d84a', '356f6646-f8c5-4a85-8dec-72e289f7d3fa', 'ab35b0e6-b501-4ff9-80ab-6999085ba926'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:19 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:19 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:19 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:20 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.273s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:20 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Deleted volume successfully. Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-8b128439-d7ec-49d4-9688-5cc093a831c8 tempest-ProjectReaderTests-437891029 None] Lock "cinder-49614789-e1bc-4138-b22d-744f99aae410-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (c7f80db1-dc42-4acf-b92e-78de61850924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb68e99-610f-4225-b1b4-19d68694d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb68e99-610f-4225-b1b4-19d68694d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026539143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9402fcf-ebdb-41ea-b151-57d105aa0fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:21Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ec5c9-1416-4053-8211-cd18bebe955f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd4ec5c9-1416-4053-8211-cd18bebe955f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc746b02-2c3f-44fa-8629-a4912ff60bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc746b02-2c3f-44fa-8629-a4912ff60bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9402fcf-ebdb-41ea-b151-57d105aa0fd9', 'volume_name': 'volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c839d0-f483-4262-a100-46d6b7edcb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c839d0-f483-4262-a100-46d6b7edcb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd38348d-0c6f-4e8b-b80e-2d18c1450ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:20 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Volume d9402fcf-ebdb-41ea-b151-57d105aa0fd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9', 'volume_size': 1} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2026539143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9402fcf-ebdb-41ea-b151-57d105aa0fd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:21Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Creating volume d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:31:20 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:31:20 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:20 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 1073741824 Sep 28 16:31:20 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:21 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 1073741824" returned: 0 in 0.488s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:21 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 Sep 28 16:31:21 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:21 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd38348d-0c6f-4e8b-b80e-2d18c1450ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3167b3cb-eec1-4d27-ac53-590d62a3edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:21 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Volume volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 (d9402fcf-ebdb-41ea-b151-57d105aa0fd9): created successfully Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3167b3cb-eec1-4d27-ac53-590d62a3edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:21 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (c7f80db1-dc42-4acf-b92e-78de61850924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:21 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-1134a7c2-aaea-4036-b425-520c2f247fc6 tempest-ProjectReaderTests-437891029 None] Created volume successfully. Sep 28 16:31:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:22 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Creating offline snapshot 83338735-01ce-4416-9d94-d8ec15e54e58 of volume d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:31:22 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[634a4d7c-305d-494e-a821-6a5d23d06571]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:22 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:23 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 Sep 28 16:31:23 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:23 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" returned: 0 in 0.401s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:23 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 1G Sep 28 16:31:23 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:23 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 1G" returned: 0 in 0.398s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:23 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:23 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 Sep 28 16:31:23 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:24 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58" returned: 0 in 0.305s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 is being set with open permissions: ugo+rw Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:24 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 Sep 28 16:31:24 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:24 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:24 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info Sep 28 16:31:24 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:24 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info" returned: 0 in 0.264s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:24 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info is being set with open permissions: ugo+rw Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:24 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info Sep 28 16:31:24 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:24 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.info" returned: 0 in 0.257s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:24 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.970s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:24 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-ca16d81c-3a52-4b7a-a98b-c40cfff04c1c tempest-ProjectReaderTests-437891029 None] Create snapshot completed successfully Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-83338735-01ce-4416-9d94-d8ec15e54e58-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-83338735-01ce-4416-9d94-d8ec15e54e58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-83338735-01ce-4416-9d94-d8ec15e54e58" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-83338735-01ce-4416-9d94-d8ec15e54e58" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Deleting offline snapshot 83338735-01ce-4416-9d94-d8ec15e54e58 of volume d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] snapshot_file for this snap is: volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e929446-3d86-482b-89a2-4fa430398fda]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:25 devstack sudo[108564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 Sep 28 16:31:25 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:25 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58" returned: 0 in 0.387s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19e965c-7942-41be-9892-ce9a5bf5ca38]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:25 devstack sudo[108569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 Sep 28 16:31:25 devstack sudo[108569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:25 devstack sudo[108569]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" returned: 0 in 0.384s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:25 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:26 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 Sep 28 16:31:26 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:26 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58" returned: 0 in 0.357s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:26 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58 Sep 28 16:31:26 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:26 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9.83338735-01ce-4416-9d94-d8ec15e54e58" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-83338735-01ce-4416-9d94-d8ec15e54e58" released by "_delete_snapshot" :: held 1.490s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" released by "delete_snapshot" :: held 1.517s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Created reservations ['e4fcf750-1f01-407b-8365-efb263156afd', 'e452fdf6-e329-4cdc-b038-6e5daffd49ec', '6ef1ca97-4757-4ce6-bcba-6fa71c39597f', '62e7e086-92ee-4ba9-b1f2-e37a23303561'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:26 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Delete snapshot completed successfully. Sep 28 16:31:26 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-20bfbd7e-f5a1-4d81-b450-50493d63221b tempest-ProjectReaderTests-437891029 None] Lock "cinder-83338735-01ce-4416-9d94-d8ec15e54e58-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-d9402fcf-ebdb-41ea-b151-57d105aa0fd9-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "cinder-d9402fcf-ebdb-41ea-b151-57d105aa0fd9-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[8787ae1f-f35c-4a1c-a0ce-f3424dfbed3c]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:27 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 Sep 28 16:31:27 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:27 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" returned: 0 in 0.375s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:27 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:27 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9 Sep 28 16:31:27 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:28 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-d9402fcf-ebdb-41ea-b151-57d105aa0fd9" released by "delete_volume" :: held 0.686s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Created reservations ['71a50408-983e-4e56-a36f-b9d1fa32a1a7', '25effa48-4670-4212-8ca7-99bd76edc268', '0b305366-7845-44aa-8ba7-743f4578137e', 'b6bfd114-2e13-4251-ac67-78efc76187cd'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:28 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:28 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:28 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.302s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:28 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Deleted volume successfully. Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-61ca269d-0768-4700-b250-1b74c53c67e1 tempest-ProjectReaderTests-437891029 None] Lock "cinder-d9402fcf-ebdb-41ea-b151-57d105aa0fd9-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (eaba6c7b-d706-45d1-b516-36805dbca9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdddb95-6bda-4758-a534-3992c61082b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abdddb95-6bda-4758-a534-3992c61082b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452605745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10e9a4-d181-4fa2-b316-bad538cd98ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:29Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372ea8de-3508-46f5-9664-84b650d730d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (372ea8de-3508-46f5-9664-84b650d730d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29487052-70e4-4113-883e-81cd24b8724f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29487052-70e4-4113-883e-81cd24b8724f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b10e9a4-d181-4fa2-b316-bad538cd98ca', 'volume_name': 'volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:28 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed3030c-82f5-4238-a404-8c78a86ff196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed3030c-82f5-4238-a404-8c78a86ff196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf9f30-41a6-4ccc-9cc1-56f27db0c9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Volume 7b10e9a4-d181-4fa2-b316-bad538cd98ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca', 'volume_size': 1} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1452605745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b10e9a4-d181-4fa2-b316-bad538cd98ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:29Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Creating volume 7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:31:29 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:29 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca 1073741824 Sep 28 16:31:29 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:29 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca 1073741824" returned: 0 in 0.471s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:29 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca Sep 28 16:31:29 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:29 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca" returned: 0 in 0.259s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf9f30-41a6-4ccc-9cc1-56f27db0c9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e904f089-41f3-4b72-8bb7-df2877649def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:29 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Volume volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca (7b10e9a4-d181-4fa2-b316-bad538cd98ca): created successfully Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e904f089-41f3-4b72-8bb7-df2877649def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:29 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (eaba6c7b-d706-45d1-b516-36805dbca9c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:29 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-50812410-189f-4d10-8fda-bfb05adc54b1 tempest-ProjectReaderTests-437891029 None] Created volume successfully. Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Creating offline snapshot 203bb32d-4caf-4129-b2b0-6a8f7298110d of volume 7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f56ec3-22e7-4b16-be87-b7ded73121a3]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:30 devstack sudo[108603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca Sep 28 16:31:30 devstack sudo[108603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:30 devstack sudo[108603]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca" returned: 0 in 0.356s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:30 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:30 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d 1G Sep 28 16:31:30 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:31 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d 1G" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:31 devstack sudo[108614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d Sep 28 16:31:31 devstack sudo[108614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:31 devstack sudo[108614]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d" returned: 0 in 0.297s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:31 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d is being set with open permissions: ugo+rw Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:31 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d Sep 28 16:31:31 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:31 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:31 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info Sep 28 16:31:31 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:31 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info" returned: 0 in 0.255s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:31 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info is being set with open permissions: ugo+rw Sep 28 16:31:31 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:31 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info Sep 28 16:31:31 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:32 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.info" returned: 0 in 0.243s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:32 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-c5a80395-d068-4949-ac82-19d97d577fda tempest-ProjectReaderTests-437891029 None] Create snapshot completed successfully Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-203bb32d-4caf-4129-b2b0-6a8f7298110d-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-203bb32d-4caf-4129-b2b0-6a8f7298110d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-203bb32d-4caf-4129-b2b0-6a8f7298110d" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-203bb32d-4caf-4129-b2b0-6a8f7298110d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Deleting offline snapshot 203bb32d-4caf-4129-b2b0-6a8f7298110d of volume 7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] snapshot_file for this snap is: volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[a107183d-e864-4ec5-9ebd-166a5f404f4f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:32 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d Sep 28 16:31:32 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:32 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d" returned: 0 in 0.372s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7fd59a-7233-4b16-b643-de89252107e9]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:32 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:33 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca Sep 28 16:31:33 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:33 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:33 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d Sep 28 16:31:33 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:33 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d" returned: 0 in 0.352s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:33 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d Sep 28 16:31:33 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:33 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca.203bb32d-4caf-4129-b2b0-6a8f7298110d" returned: 0 in 0.271s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-203bb32d-4caf-4129-b2b0-6a8f7298110d" released by "_delete_snapshot" :: held 1.471s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:33 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" released by "delete_snapshot" :: held 1.493s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Created reservations ['a7c50069-bdfc-4ae9-92f9-7a1eb56ff852', '8f2c2f9d-dadd-40c9-9469-f639a085eb5a', '91474bf7-7a54-4a16-893c-7ec54ec2e842', 'e4ffd358-0dd6-4111-924b-58fb6db05001'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:34 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Delete snapshot completed successfully. Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-00ae2cfc-8384-4b92-bfb9-b8cb2cb3d52a tempest-ProjectReaderTests-437891029 None] Lock "cinder-203bb32d-4caf-4129-b2b0-6a8f7298110d-delete_snapshot" released by "delete_snapshot" :: held 1.629s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-7b10e9a4-d181-4fa2-b316-bad538cd98ca-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "cinder-7b10e9a4-d181-4fa2-b316-bad538cd98ca-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" acquired by "delete_volume" :: waited 0.022s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[c421fa55-3796-4932-b603-7c54ee1fdc75]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:34 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:34 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca Sep 28 16:31:34 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:35 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca" returned: 0 in 0.385s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:35 devstack sudo[108651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca Sep 28 16:31:35 devstack sudo[108651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:35 devstack sudo[108651]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-7b10e9a4-d181-4fa2-b316-bad538cd98ca" returned: 0 in 0.254s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-7b10e9a4-d181-4fa2-b316-bad538cd98ca" released by "delete_volume" :: held 0.706s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Created reservations ['c97cfd1c-71c7-435b-a8db-a5daf2fc9def', 'b7722963-7383-4f03-a800-127728f56194', 'e642f0fd-a284-4ce9-8901-12cc9b981d9c', '9ccfc335-c8a0-4579-9074-8370c9c47681'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:35 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:35 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:35 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.266s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:35 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Deleted volume successfully. Sep 28 16:31:35 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-174ed7e5-dae2-4bd7-a1ba-0a59d58073d5 tempest-ProjectReaderTests-437891029 None] Lock "cinder-7b10e9a4-d181-4fa2-b316-bad538cd98ca-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (a2f61cff-66d4-483a-a7ef-15f10255d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902829a0-286b-4a81-a52e-9b64f5f8ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (902829a0-286b-4a81-a52e-9b64f5f8ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139007676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5e4241-cced-4781-81fa-66223d0e9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:36Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a24d7cf-9a69-4e04-a24b-bba1e25fda1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a24d7cf-9a69-4e04-a24b-bba1e25fda1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ba9a7d-7782-4bfb-894e-9155e933b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99ba9a7d-7782-4bfb-894e-9155e933b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab5e4241-cced-4781-81fa-66223d0e9c86', 'volume_name': 'volume-ab5e4241-cced-4781-81fa-66223d0e9c86', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18285b5-8c84-43ab-a957-c0940b88e61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f18285b5-8c84-43ab-a957-c0940b88e61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b5eb54-a1e9-443f-ae4f-11db98ab0cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:36 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Volume ab5e4241-cced-4781-81fa-66223d0e9c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab5e4241-cced-4781-81fa-66223d0e9c86', 'volume_size': 1} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-139007676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab5e4241-cced-4781-81fa-66223d0e9c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:36Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Creating volume ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:31:36 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:36 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 1073741824 Sep 28 16:31:36 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:36 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:36 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:36 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 1073741824" returned: 0 in 0.453s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:36 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.278s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_service.periodic_task [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] Running periodic task VolumeManager._thread_info {{(pid=87150) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread count: 28 {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-a98ce003-3023-494c-b3a9-b3c34f33a2a1 None None] thread info: [<_MainThread(MainThread, started 125577278566528)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87150) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 28 16:31:36 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:36 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 Sep 28 16:31:36 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:37 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86" returned: 0 in 0.245s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30b5eb54-a1e9-443f-ae4f-11db98ab0cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab5e4241-cced-4781-81fa-66223d0e9c86', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac98b4e8-4120-4816-b57d-6e696aebeb4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:37 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Volume volume-ab5e4241-cced-4781-81fa-66223d0e9c86 (ab5e4241-cced-4781-81fa-66223d0e9c86): created successfully Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac98b4e8-4120-4816-b57d-6e696aebeb4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (a2f61cff-66d4-483a-a7ef-15f10255d920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:37 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-9e260a2b-9bf5-47fd-b315-57e83fed1ccd tempest-ProjectReaderTests-437891029 None] Created volume successfully. Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Creating offline snapshot 4f0fb628-dc17-4a92-b161-621b4977858a of volume ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85d0e67-d2d5-440c-a54e-f4c8f6dcb13d]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:37 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 Sep 28 16:31:37 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:37 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86" returned: 0 in 0.371s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:37 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:37 devstack sudo[108674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a 1G Sep 28 16:31:37 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:38 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a 1G" returned: 0 in 0.395s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5e4241-cced-4781-81fa-66223d0e9c86 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:38 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5e4241-cced-4781-81fa-66223d0e9c86 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a Sep 28 16:31:38 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:38 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab5e4241-cced-4781-81fa-66223d0e9c86 -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a" returned: 0 in 0.300s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:38 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a is being set with open permissions: ugo+rw Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:38 devstack sudo[108684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a Sep 28 16:31:38 devstack sudo[108684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:38 devstack sudo[108684]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a" returned: 0 in 0.256s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:38 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:38 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info Sep 28 16:31:38 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:39 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info" returned: 0 in 0.269s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:39 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info is being set with open permissions: ugo+rw Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:39 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info Sep 28 16:31:39 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:39 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.info" returned: 0 in 0.251s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:39 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-e7a52aa8-cbe8-4000-81ad-ee106be28297 tempest-ProjectReaderTests-437891029 None] Create snapshot completed successfully Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-4f0fb628-dc17-4a92-b161-621b4977858a-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-4f0fb628-dc17-4a92-b161-621b4977858a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-4f0fb628-dc17-4a92-b161-621b4977858a" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-4f0fb628-dc17-4a92-b161-621b4977858a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Deleting offline snapshot 4f0fb628-dc17-4a92-b161-621b4977858a of volume ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] snapshot_file for this snap is: volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6fafe0-2d2d-451b-84db-59a4e86483e7]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:39 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:39 devstack sudo[108693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a Sep 28 16:31:39 devstack sudo[108693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:40 devstack sudo[108693]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a" returned: 0 in 0.370s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab5e4241-cced-4781-81fa-66223d0e9c86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1b62c4-f27b-4e7d-a38f-6640c55fef9f]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:40 devstack sudo[108698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 Sep 28 16:31:40 devstack sudo[108698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:40 devstack sudo[108698]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86" returned: 0 in 0.383s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:40 devstack sudo[108704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a Sep 28 16:31:40 devstack sudo[108704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:40 devstack sudo[108704]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a" returned: 0 in 0.351s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:40 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:40 devstack sudo[108709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a Sep 28 16:31:40 devstack sudo[108709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:41 devstack sudo[108709]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86.4f0fb628-dc17-4a92-b161-621b4977858a" returned: 0 in 0.276s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-4f0fb628-dc17-4a92-b161-621b4977858a" released by "_delete_snapshot" :: held 1.490s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" released by "delete_snapshot" :: held 1.512s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Created reservations ['01a62233-d996-444c-aca1-6782d064d341', 'f522e4bf-3f69-4da0-8296-8753fa049990', '4c214962-3e77-49f9-a2b7-ee3fc5804bf0', '8f1334cb-a689-4682-adfc-d0ee78a85a1c'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:41 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Delete snapshot completed successfully. Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-fe72840e-9a3f-4001-abf1-9faceeb6f4a4 tempest-ProjectReaderTests-437891029 None] Lock "cinder-4f0fb628-dc17-4a92-b161-621b4977858a-delete_snapshot" released by "delete_snapshot" :: held 1.646s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-ab5e4241-cced-4781-81fa-66223d0e9c86-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "cinder-ab5e4241-cced-4781-81fa-66223d0e9c86-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" acquired by "delete_volume" :: waited 0.016s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa725467-c825-4d35-a7e7-dc753a3f8c32]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:41 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:41 devstack sudo[108712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 Sep 28 16:31:41 devstack sudo[108712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:42 devstack sudo[108712]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86" returned: 0 in 0.373s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:42 devstack sudo[108717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86 Sep 28 16:31:42 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:42 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-ab5e4241-cced-4781-81fa-66223d0e9c86" returned: 0 in 0.287s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-ab5e4241-cced-4781-81fa-66223d0e9c86" released by "delete_volume" :: held 0.725s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Created reservations ['96c86011-d8b6-4001-aee6-df46bffeb79f', '3e74ec0a-fddf-472b-9c96-707a0d238c37', '1e40d1f7-efc8-4388-bd62-f4ef3763cc1b', 'c2793eae-6ef0-4f88-a32c-be2d2bdc5c65'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:42 devstack sudo[108720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:42 devstack sudo[108720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:42 devstack sudo[108720]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.248s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:42 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Deleted volume successfully. Sep 28 16:31:42 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-746a2c8b-b444-49c2-a312-5692937c67e7 tempest-ProjectReaderTests-437891029 None] Lock "cinder-ab5e4241-cced-4781-81fa-66223d0e9c86-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.flows.manager.create_volume [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87150) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (9d07d7d5-cd9b-4773-97e8-ab623f941674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f3133-26c1-41a4-ad67-e481ddd81515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298f3133-26c1-41a4-ad67-e481ddd81515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547293880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057597a-9db1-475c-b486-cc25b16f8d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:43Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75042711-05ff-46de-9422-4f2ecf83626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75042711-05ff-46de-9422-4f2ecf83626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed96e140-20fe-44c5-90e2-d250e4c7dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed96e140-20fe-44c5-90e2-d250e4c7dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f057597a-9db1-475c-b486-cc25b16f8d3d', 'volume_name': 'volume-f057597a-9db1-475c-b486-cc25b16f8d3d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b26c72-ebe3-423d-a8d3-1c96b3c4c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b26c72-ebe3-423d-a8d3-1c96b3c4c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e3a6bb-57ae-4a45-b10d-17f6a101f740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:43 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Volume f057597a-9db1-475c-b486-cc25b16f8d3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f057597a-9db1-475c-b486-cc25b16f8d3d', 'volume_size': 1} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-28T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547293880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f057597a-9db1-475c-b486-cc25b16f8d3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c44f721731dc45a4842af8dc23271c4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-28T14:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-28T14:31:43Z,use_quota=True,user_id='5b906b1bc8344e8cb98ffa9eaa625d3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(23637f68-55ea-4fb3-9e87-b104b043314a),volume_type_id=23637f68-55ea-4fb3-9e87-b104b043314a)}" {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Creating volume f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Selected osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 as target Quobyte volume. {{(pid=87150) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 28 16:31:43 devstack cinder-volume[87150]: INFO cinder.volume.drivers.remotefs [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] casted to osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3 Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d 1073741824 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:43 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d 1073741824 Sep 28 16:31:43 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:43 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d 1073741824" returned: 0 in 0.454s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:43 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:43 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d Sep 28 16:31:43 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:44 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d" returned: 0 in 0.246s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'} {{(pid=87150) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3e3a6bb-57ae-4a45-b10d-17f6a101f740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f057597a-9db1-475c-b486-cc25b16f8d3d', 'volume_size': 1}' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6324af-85ca-4e15-b43e-1b76d7452b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 28 16:31:44 devstack cinder-volume[87150]: INFO cinder.volume.flows.manager.create_volume [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Volume volume-f057597a-9db1-475c-b486-cc25b16f8d3d (f057597a-9db1-475c-b486-cc25b16f8d3d): created successfully Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd6324af-85ca-4e15-b43e-1b76d7452b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87150) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Flow 'volume_create_manager' (9d07d7d5-cd9b-4773-97e8-ab623f941674) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87150) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 28 16:31:44 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-05d509d7-4e2d-4efb-b604-bae511db7cb2 tempest-ProjectReaderTests-437891029 None] Created volume successfully. Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Creating offline snapshot be44f9e1-289a-4d5c-8eec-ce2de04d2264 of volume f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e4d3c-ec1f-4eb9-b9cb-29435e2de0bb]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:44 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:44 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d Sep 28 16:31:44 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:45 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d" returned: 0 in 0.366s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 1G {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:45 devstack sudo[108736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 1G Sep 28 16:31:45 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:45 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 1G" returned: 0 in 0.442s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f057597a-9db1-475c-b486-cc25b16f8d3d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:45 devstack sudo[108741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f057597a-9db1-475c-b486-cc25b16f8d3d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 Sep 28 16:31:45 devstack sudo[108741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:45 devstack sudo[108741]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f057597a-9db1-475c-b486-cc25b16f8d3d -F qcow2 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264" returned: 0 in 0.294s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:45 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 is being set with open permissions: ugo+rw Sep 28 16:31:45 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:45 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 Sep 28 16:31:45 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:46 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264" returned: 0 in 0.234s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:46 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info Sep 28 16:31:46 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:46 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info" returned: 0 in 0.281s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:46 devstack cinder-volume[87150]: WARNING cinder.volume.drivers.remotefs [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info is being set with open permissions: ugo+rw Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:46 devstack sudo[108752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info Sep 28 16:31:46 devstack sudo[108752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:46 devstack sudo[108752]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.info" returned: 0 in 0.274s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:46 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-f17882d3-25a5-407e-b6dc-d893c030ba42 tempest-ProjectReaderTests-437891029 None] Create snapshot completed successfully Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-be44f9e1-289a-4d5c-8eec-ce2de04d2264-delete_snapshot" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-be44f9e1-289a-4d5c-8eec-ce2de04d2264-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" by "delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-be44f9e1-289a-4d5c-8eec-ce2de04d2264" by "_delete_snapshot" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-be44f9e1-289a-4d5c-8eec-ce2de04d2264" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Deleting offline snapshot be44f9e1-289a-4d5c-8eec-ce2de04d2264 of volume f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] snapshot_file for this snap is: volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4f84e1-b154-4af8-8b23-8c45769b1bcf]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:46 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:47 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 Sep 28 16:31:47 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:47 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264" returned: 0 in 0.379s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.remotefs [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f057597a-9db1-475c-b486-cc25b16f8d3d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87150) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4afff6-ddf7-4bcb-b675-29f87799fc80]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:47 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d Sep 28 16:31:47 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:47 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d" returned: 0 in 0.367s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:47 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:47 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 Sep 28 16:31:47 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:48 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264" returned: 0 in 0.333s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:48 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264 Sep 28 16:31:48 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:48 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d.be44f9e1-289a-4d5c-8eec-ce2de04d2264" returned: 0 in 0.262s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-be44f9e1-289a-4d5c-8eec-ce2de04d2264" released by "_delete_snapshot" :: held 1.449s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" released by "delete_snapshot" :: held 1.471s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Created reservations ['7110e620-559b-4ba2-80cd-133064ba19a4', '7bef53ac-173d-4e3f-a8a5-bdb6e0f52a7d', '0330648c-8724-4950-9e2c-61260bf4bb7d', '05756a79-cb05-4376-9b66-729f899553a6'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:48 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Delete snapshot completed successfully. Sep 28 16:31:48 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-d9d1435b-220a-405e-8e86-bbd2908ebfcf tempest-ProjectReaderTests-437891029 None] Lock "cinder-be44f9e1-289a-4d5c-8eec-ce2de04d2264-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-f057597a-9db1-475c-b486-cc25b16f8d3d-delete_volume" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "cinder-f057597a-9db1-475c-b486-cc25b16f8d3d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Acquiring lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" by "delete_volume" {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" acquired by "delete_volume" :: waited 0.018s {{(pid=87150) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0e001-b3eb-44a5-ab69-1c18919a7e36]: (4, 'qcow2') {{(pid=88208) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:49 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d Sep 28 16:31:49 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:49 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d" returned: 0 in 0.389s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:49 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d Sep 28 16:31:49 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:49 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7/volume-f057597a-9db1-475c-b486-cc25b16f8d3d" returned: 0 in 0.244s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "cinder-quobyte-f057597a-9db1-475c-b486-cc25b16f8d3d" released by "delete_volume" :: held 0.698s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.quota [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Created reservations ['5868de3d-fc8c-4efa-8296-da89562c0aea', '5e036d65-1fb0-45a3-8d3f-ef6b6b8c4884', 'c019395a-34ac-4a08-a79e-3c7f7f729431', '003d46c0-ca4a-4524-a6c8-3ca24c027457'] {{(pid=87150) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3': None} {{(pid=87150) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG cinder.volume.drivers.quobyte [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ac1d056a-147e-4e20-8e7c-7c860749eea3'] {{(pid=87150) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.lockutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87150) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 28 16:31:49 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 28 16:31:49 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7 Sep 28 16:31:49 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 28 16:31:50 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 28 16:31:50 devstack cinder-volume[87150]: DEBUG oslo_concurrency.processutils [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/9ff064b43dc21fc4885c72b500bdc6a7" returned: 0 in 0.267s {{(pid=87150) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 28 16:31:50 devstack cinder-volume[87150]: DEBUG cinder.manager [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Notifying Schedulers of capabilities ... {{(pid=87150) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 28 16:31:50 devstack cinder-volume[87150]: INFO cinder.volume.manager [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Deleted volume successfully. Sep 28 16:31:50 devstack cinder-volume[87150]: DEBUG cinder.coordination [None req-cc516ed5-4551-4a4d-a999-fb38f99972d2 tempest-ProjectReaderTests-437891029 None] Lock "cinder-f057597a-9db1-475c-b486-cc25b16f8d3d-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87150) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 28 16:31:59 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=70,cinder:UPDATE=88,cinder:DELETE=6,cinder:INSERT=26 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 28 16:32:00 devstack cinder-volume[87150]: DEBUG dbcounter [-] [87150] Writing DB stats cinder:SELECT=71,cinder:UPDATE=93,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87150) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}